KR20190105486A - System and method for evaluating ocular motility disturbance and computer readable storage medium - Google Patents

Abstract

According to an embodiment of the present invention, an eye movement disorder evaluation method comprises the steps of: acquiring a reference eye photograph obtained by capturing an image of an eye when an eye evaluation subject looks at the front, and a plurality of comparative eye photographs obtained by capturing an image of the eye when the eye evaluation subject looks in a radial direction according to a predetermined condition with respect to the state in which the eye evaluation subject looks at the front; mapping a grid of a rectangular shape to the reference eye photograph to include the pupil and the sclera of the reference eye photograph; extracting the pupil of the reference eye photograph to which the grid is mapped so as to set the center of the extracted pupil as a reference coordinate, and extracting the pupil of the comparative eye photograph so as to set the center of the pupil of the extracted comparative eye photograph as a comparative coordinate; calculating the displacement of the pupil based on the deviation from the reference coordinate to the comparative coordinate, calculating a torsion angle at which the torsion of the pupil is performed, and comparing the pupil displacement and the torsion angle with a preset normal range so as to analyze movement patterns of both eyes; and determining the presence or absence of a disorder of the eye evaluation subject based on the movement pattern of the both eyes.

Description

System for evaluating ocular motility disorder, method for evaluating ocular motility disorder using the same and computer readable storage medium

The present invention relates to a system for evaluating eye movement disorders and a method for evaluating eye movement disorders using the same, and more specifically, eye movements by comparing eye positions when eyes are facing the front and eye positions when eyes are radiated. The present invention relates to a system for evaluating eye movement disorders and a method for evaluating eye movement disorders using the same.

Eye movement disorders include the superior rectus, the inferior rectus, the medial rectus, the lateral rectus, the superior oblique and the inferior oblique. 6) muscles (see FIG. 2) and junctional and brain lesions of the nerves and muscles 3, 4, and 6 that control these muscles.

Disability pattern analysis according to eye movements allows the eye to move to various locations to analyze the disability pattern of eye movements to distinguish the damaged areas among them, and to estimate the etiology based on this. However, at present, evaluation of eye movements is quantitatively judged and evaluation methods based on eye movement disorders have not been clearly presented, and the doctor directly evaluates eye movements to visually predict the disordered areas. It is a situation.

Such visual evaluation has a high possibility of misdiagnosis because it is difficult to accurately judge the eye movements that make small changes.

Therefore, the necessity of developing a technology that can more clearly and accurately analyze the pattern of eye movement disorder is increasing.

(Korean Patent Publication No. 2003-0087101, November 13, 2003)

An object of the present invention by comparing the eye position when the eye gazes the front and the position of the eye when gaze the radial direction to quantitatively determine whether the eye movement is appropriate to determine whether there is an eye movement disorder of the eye evaluation subjects The present invention provides an eye movement disorder evaluation system and an eye movement disorder evaluation method using the same.

The object of the present invention is not limited to the above-mentioned object, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the eye movement disorder evaluation system according to an embodiment of the present invention, the eyeball subject reference image photographing the eye when the subject is looking at the front and the eye evaluation subject is looking at the front An imaging unit which picks up a plurality of comparative eye pictures of the eyeballs when the radiation direction is observed according to a condition preset to the state; And communicating wirelessly with the imaging unit, analyzing the movement patterns of both eyes using the reference eye photograph and the plurality of comparative eye photographs received from the imaging unit, and analyzing the movement patterns of both eyes based on the movement patterns of both eyes. It includes a server for determining whether there is a failure, The server, Data storage unit for storing the reference eye picture and the plurality of comparison eye picture received from the imaging unit; Map a rectangular grid to include the pupil and sclera in the reference eye photograph, extract the pupil of the reference eye photograph to which the grid is mapped, and set the center of the extracted pupil as reference coordinates, and the pupil of the comparative eye photograph. A displacement calculation unit configured to extract and set a center of the extracted pupil as a comparative coordinate, and calculate a displacement of the pupil based on the deviation from the reference coordinate to the comparative coordinate; After mapping a plurality of virtual lines from the center of the pupil to the outer peripheral surface of the iris in the radial direction, measuring the length of the plurality of virtual lines, and determining the iris shape based on the measured length of each virtual line, A line angle calculator configured to calculate the line angle by comparing an iris shape between a reference eye picture and the plurality of comparative eye pictures; And it may include a disability determination unit for determining the presence or absence of the disorder of the eye assessment target based on the displacement or the line angle of the pupil.

Eye movement disorder evaluation method according to an embodiment of the present invention, the eye based on the pre-determined condition for photographing the eyeballs and the state of the eyeball evaluation subjects eye image when the eyeballs subject gaze at the front Photographing a plurality of comparative eye photographs photographing the eye when viewing the direction; Mapping a grid having a rectangular shape to the reference eye photograph to include the pupil and the sclera of the reference eye photograph; Extracting the pupil of the grid-mapped reference eye photograph to set the center of the extracted pupil as a reference coordinate, and extracting the pupil of the comparative eye photograph to set the center of the pupil of the extracted comparative eye photograph as the comparative coordinate step; Compute the pupil displacement based on the deviation from the reference coordinate to the comparative coordinate, calculate the torsion angle at which the pupil is convoluted, and compare the pupil displacement and the convolution angle with a preset normal range. Analyzing the movement pattern of the; And determining whether there is a disorder of the eye assessment subject based on the exercise pattern of both eyes.

Eye movement disorder evaluation system according to an embodiment of the present invention and the eye movement disorder evaluation method using the same can be estimated quantitatively to estimate the eye position when looking at the front and the radial direction eyeball eye evaluation Accurately determine the eye movement of the subject, and based on this, it is possible to more objectively determine and diagnose the subjects of the ocular evaluation subjects.

The effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a conceptual diagram showing the movement state of the eye for explaining the present invention.
Figure 2 is a conceptual diagram showing the name of the eye and the muscle surrounding the eye for explaining the present invention.
3 is a flowchart of a method for evaluating eye movement disorder according to an embodiment of the present invention.
4 is a conceptual diagram illustrating a state in which a grid is mapped to an eyeball according to an embodiment of the present invention.
5A to 5C are conceptual views illustrating a method of calculating the eyeball line angle according to an embodiment of the present invention.
Figure 6 is a block diagram of an eye movement disorder evaluation system according to an embodiment of the present invention.

The following merely illustrates the principles of the invention. Those skilled in the art, although not explicitly described or illustrated herein, may embody the principles of the present invention and invent various devices that fall within the spirit and scope of the present invention. In addition, all conditional terms and embodiments listed herein are in principle clearly intended to be understood only for the purpose of understanding the concept of the invention and are not to be limited to the specifically listed embodiments and states. do.

In addition, it is to be understood that all detailed descriptions, including the specific embodiments, as well as the principles, aspects, and embodiments of the present invention, are intended to include structural and functional equivalents thereof. In addition, these equivalents should be understood to include not only equivalents now known, but also equivalents to be developed in the future, that is, all devices invented to perform the same function regardless of structure.

Thus, for example, it should be understood that the block diagrams herein represent a conceptual view of example circuitry embodying the principles of the invention. Similarly, all flowcharts, state transitions, pseudocodes, and the like are understood to represent various processes performed by a computer or processor, whether or not the computer or processor is substantially illustrated on a computer readable medium and whether the computer or processor is clearly shown. Should be.

The functionality of the various elements shown in the figures, including functional blocks represented by a processor or similar concept, can be provided by the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functionality may be provided by a single dedicated processor, by a single shared processor or by a plurality of individual processors, some of which may be shared.

In addition, the explicit use of terms presented in terms of processor, control, or similar concept should not be interpreted exclusively as a citation to hardware capable of running software, and without limitation, ROM for storing digital signal processor (DSP) hardware, software. (ROM), RAM, and non-volatile memory are to be understood to implicitly include. It may also include hardware for the governor.

In the claims of this specification, components expressed as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements or firmware / microcode, etc. that perform the functions. It is intended to include all methods of performing a function which are combined with appropriate circuitry for executing the software to perform the function. The invention, as defined by these claims, is equivalent to what is understood from this specification, as any means capable of providing such functionality, as the functionality provided by the various enumerated means are combined, and in any manner required by the claims. It should be understood that.

The above objects, features, and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Figure 3 is a flow chart of the eye movement disorder evaluation method according to an embodiment of the present invention, Figure 4 is a conceptual diagram showing a state in which the grid is mapped to the eye according to an embodiment of the present invention, Figures 5a to 5c is a view of the present invention According to an embodiment, it is a conceptual diagram illustrating a method of calculating the eyeball line angle.

Referring to Figure 3 to 5c, eye movement disorder evaluation method according to an embodiment of the present invention the step of photographing the reference eye pictures and comparative eye pictures (S100), mapping the grid (S200), reference coordinates And setting the comparative coordinates (S300), analyzing the movement patterns of both eyes (S400), and determining the presence or absence of the subject's disability (S500).

First, in the step (S100) of capturing the reference eye photograph and the comparative eye photograph, the eye of the eyeball evaluator is imaged using the imaging unit. Here, both eyes of the subject of eye evaluation subjects are photographed, and the reference direction photograph photographing the eye when the subject of eye evaluation subjects looks in front and the direction of radiation according to a predetermined condition for the state in which the eye evaluation subjects looks in front. In this case, a plurality of comparative eye photographs obtained by photographing the eyeballs can be captured. The photographed reference eye photograph and comparative eye photograph are respectively stored.

According to one embodiment, the comparative eye photograph is as shown in Figure 1 based on the eye to the eye evaluation subject, up, down, left, right, top left (upward left), top right (upward right side) ), The lower left (lower left side) and the right (lower right side) are photographs photographing the eyeballs in the state observed.

In the step of mapping the grid (S200), the grid G of the rectangular shape is mapped to the reference eye photograph such that the pupil P and the sclera S of the reference eye photograph are included. 4 illustrates a state in which a grid is mapped to an eye according to an embodiment of the present invention. To this end, the method may further include extracting an area including the pupil and the sclera from the photographed image. In addition, the step of mapping the grid (S200) extracts the length A and length B of the grid G mapped to the reference eye photograph. In addition, the length L between the upper and lower eyelids can be extracted from the grid-mapped reference eye photograph.

In the setting of the reference coordinate and the comparative coordinate (S300), the pupil of the grid-mapped reference eye photograph is extracted and the center of the extracted pupil is set as the reference coordinate, and the center of the pupil extracted from the comparative eye photograph is used as the comparative coordinate. Set it.

Step (S400) of analyzing the movement pattern of both eyes calculates the displacement of the pupil based on the deviation from the reference coordinate to the comparative coordinate, calculates the angle of the torsion of the pupil, the displacement of the pupil and the convolution Analyze the movement pattern of both eyes based on the torsion angle.

Specifically, the deviation between the reference coordinate value, which is the center of the pupil when each eye looks at the front face, and the comparative coordinate value, which is the center of the pupil when each eye is observed, is calculated to calculate the displacement of the pupil. can do.

In addition, a plurality of virtual lines a, b, c, d, e, f, and g are radially mapped from the center of the eye pupil to the outer circumferential surface of the iris in the reference eye photograph. Here, the plurality of virtual lines may be a radius from one pupil to the outer peripheral surface of the iris with respect to the pupil center as shown in FIGS. It may be. In addition, the plurality of virtual lines may be formed at equal intervals (unit: °) with respect to the iris. Next, the lengths of the plurality of virtual lines are measured, and the iris shape of the reference eye photograph is determined based on the calculated lengths of the virtual lines. Here, the iris shape means a shape including from the center of the pupil to the outer peripheral surface of the iris. In addition, in order to accurately determine the shape of the iris, the number of virtual lines is preferably as large as possible.

The iris is formed in an elliptical shape because the distance from the center point of the pupil to the outer circumferential surface is different, and the distance value from the center point of the pupil to the boundary of the iris does not change even during the torsion of the eye.

In other words, in contrast to the reference eye photograph of FIG. 5A and the comparative eye photograph when the right eye is looking downward to the left side as shown in FIG. 5B, there is no change in the length of the plurality of virtual lines and the angle between the adjacent virtual lines. .

Therefore, the torsion angle of the eye can be calculated by comparing the shape of the iris in the reference eye photograph and the comparison eye photograph. Referring to FIG. 5C, the eyeball may perform a horizontal motion 51 moving along the Y axis, a vertical motion 52 moving along the Z axis, and a circular motion 53 rotating along the X axis. torsion) means the angle of the eye's line about the X axis.

In addition, analyzing the movement pattern of both eyes (S400) analyzes the movement pattern of both eyes by comparing the displacement and torsion angle of each pupil of the eyes with a predetermined normal range. Here, the preset normal range refers to the displacement of the pupil and the line angle that can be viewed as a medically normal range with respect to the direction that both eyes observe, and may be a value set in consideration of individual deviation.

Step (S500) of determining the presence or absence of a disability determines the presence or absence of a disorder of the eye assessment subjects based on the movement pattern of both eyes.

Specifically, the step (S500) of determining whether there is a disorder is responsible for the movement of the eye of the subject to the eye evaluation subject based on a result of comparing the displacement and / or torsion angle of at least one pupil of both eyes with a predetermined normal range. Determine if you have a muscle disorder.

For example, the step (S500) of determining whether there is a disorder may include a disorder in muscles that are responsible for movement of the eye to the normal range if the displacement or the torsion angle of the pupil of the eye does not fall within the preset normal range. It can be judged that.

In operation S500, if the difference between the pupil displacement or the torsion angle is greater than or equal to a preset threshold, the muscle in charge of the eye movement may be determined to have a disorder. Here, the predetermined threshold value means a threshold value in which the difference in the displacement of the pupils or the line angles of the pupils with respect to the direction that both eyes observe is a threshold value that can be determined to be medically impaired. Can be.

In addition, the step (S500) of determining the presence or absence of the disorder may determine whether the eyelid seizure of the subject of the eye evaluation subject based on the length (L) between the upper and lower eyelids extracted from the reference eye photograph taken while looking at the front. For example, if the length (L) between the upper and lower eyelids of one eye is less than the preset threshold, or if the difference in the length (L) between the upper and lower eyelids of both eyes is greater than or equal to the preset threshold, the ptosis is determined. can do.

In addition, according to an embodiment of the present invention, a computer-readable storage medium having recorded thereon instructions executable by a processor for executing each step of the ocular movement disorder evaluation method as shown in FIG. 3 may be provided.

Figure 6 is a block diagram of an eye movement disorder evaluation system according to an embodiment of the present invention.

Referring to Figure 6, the eye movement disorder evaluation system according to an embodiment of the present invention is configured to include an imaging unit 110 and the server 120.

The imaging unit 110 is a reference eye photograph photographing the eye when the eye evaluation subject looks at the front face, and the eyeball when looking at the radial direction in accordance with a predetermined condition for the state in which the eye evaluation subject looks at the front. A plurality of captured comparative eye pictures are captured.

In this case, the imaging unit 110 may be implemented as an HMD having an imaging module capable of imaging the eyeball. According to one embodiment, the display frame of the HMD can provide a marker for the eye assessment subjects to observe the direction of the up, down, left, right, top, top, bottom and bottom, and the eye assessment subject to provide a marker When looking, eyeballs can be photographed to capture a plurality of comparative eyeball photographs. As such, when the imaging unit 110 is implemented as an HMD, an image is provided in a state where the HMD is fixed to the head even when the eye evaluation target moves, so that an error that may occur when photographing the eye image may be relatively reduced. do.

In addition, since the imaging unit 110 implemented with the HMD has a wireless communication module, it is possible to wirelessly transmit the reference eye photograph and the plurality of comparative eye photographs photographed through the HMD to the server 120.

However, the imaging unit 110 is not necessarily limited to the HMD, and is worn on the head such as smart glasses, smart goggles, and a display helmet, so that both eyes and the display of the subject are evaluated regardless of the movement of the subject. It may be implemented in a form that can be spaced apart by a predetermined distance and the both eyes of the subject to the eye evaluation.

The server 120 wirelessly communicates with the imaging unit 110, and analyzes movement patterns of both eyes using reference eye pictures and a plurality of comparative eye pictures received from the imaging unit 110, and based on the movement patterns of both eyes. In order to determine the presence or absence of the obstacle of the eye evaluation target, and includes a data storage unit 121, displacement calculation unit 122, the line angle calculation unit 123 and the failure determination unit 124.

The data storage unit 121 stores the reference eye photograph and the plurality of comparative eye photographs received from the imaging unit 110.

 The displacement calculator 122 calculates the displacement of the pupil by comparing the reference eye photograph with the plurality of comparative eye photographs. According to an embodiment, the displacement calculator 122 maps a rectangular grid to include the pupil and the sclera in the reference eye photograph, and extracts the pupil of the reference eye photograph to which the grid is mapped, based on the center of the extracted pupil. The coordinates are set, the pupils of the comparative eye photograph are extracted, the centers of the extracted pupils are set as the comparative coordinates, and the displacement of the pupils is calculated based on the deviation from the reference coordinates to the comparative coordinates. In addition, the displacement calculator 122 may extract the length L between the upper and lower eyelids from the grid-mapped reference eye photograph.

The line angle calculator 123 maps a plurality of virtual lines from the eye pupil center of the reference eye photograph to the outer circumferential surface of the iris in the radial direction, measures the length of each of the plurality of virtual lines, connects the ends of the virtual lines, Confirm the shape. In addition, the line angle calculator 123 calculates a torsion angle of the eye by comparing the shape of the iris in the reference eye picture and the comparison eye picture.

The disability determining unit 124 determines the presence or absence of a disability of the eye assessment subject based on the displacement of the pupil and / or the torsion angle calculated by the displacement calculator 122 and the line angle calculator 123, respectively.

In addition, the disability determining unit 124 determines whether or not the eyelid subject is eyelid based on the length L between the upper and lower eyelids calculated by the displacement calculator 122.

The server 120 analyzes the movement patterns of both eyes using the reference eye picture and the plurality of comparative eye pictures, and determines the presence or absence of a disorder of the eye evaluation subject based on the movement patterns of both eyes as shown in FIGS. 3 to 5C. Since it is the same as described in detail with reference, duplicate description thereof will be omitted.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples to easily explain the technical contents and help the understanding of the present invention, and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be implemented in addition to the embodiments disclosed herein.

110: imaging unit 120: server
121: data storage unit 122: displacement calculation unit
123: line angle calculation unit 124: failure determination unit

Claims (7)

A plurality of comparative eyes which photographed the eye images when the eye evaluation subject looked at the front eye and the eye direction when the eye evaluation subject looked at the radial direction according to a preset condition for the state where the eye evaluation subject looked at the front face. Taking a picture;
Mapping a grid having a rectangular shape to the reference eye photograph to include the pupil and the sclera of the reference eye photograph;
Extracting the pupil of the grid-mapped reference eye photograph to set the center of the extracted pupil as a reference coordinate, and extracting the pupil of the comparative eye photograph to set the center of the pupil of the extracted comparative eye photograph as the comparative coordinate step;
Compute the pupil displacement based on the deviation from the reference coordinate to the comparative coordinate, calculate the torsion angle at which the pupil is convoluted, and compare the pupil displacement and the convolution angle with a preset normal range. Analyzing the movement pattern of the; And
Eye movement disorder evaluation method comprising the step of determining the presence or absence of the disorder of the eye evaluation subject based on the movement pattern of both eyes.
The method of claim 1,
Analyzing the movement pattern of both eyes,
After mapping a plurality of virtual lines from the center of the pupil to the outer peripheral surface of the iris in the radial direction, measuring the length of the plurality of virtual lines, and determining the iris shape based on the measured length of each virtual line, An eye movement disorder evaluation method for calculating an angle of torsion by comparing an iris shape in a reference eye photograph and a plurality of comparative eye photographs.
The method of claim 1,
Determining the presence or absence of the failure,
A method for evaluating ocular movement disorder in which the muscle responsible for movement of the eyeball to the normal range is judged to be impaired if the pupil displacement or torsion angle of the eyeball does not fall within the predetermined normal range.
The method of claim 1,
Determining the presence or absence of the failure,
Eye movement disorder evaluation method for determining that the muscles responsible for the eye movement is impaired if the difference in the displacement of the pupil or the difference in the torsion angle of the pupil of the two eyes or more.
The method of claim 1,
Determining the presence or absence of the failure,
Eye movement disorder judged by ptosis when the length between the upper and lower eyelids of one eye extracted from the reference eye photograph is less than the preset threshold, or the difference between the upper and lower eyelids of both eyes is more than the preset threshold Assessment Methods.
Comparison of a plurality of images photographing the eye when the eye evaluation subject is looking at the front face and the eye when the eye evaluation subject is looking at the radial direction according to a predetermined condition for the state in which the eye evaluation subject is looking at the front An imaging unit for photographing an eyeball photograph; And
Wirelessly communicate with the imaging unit, analyze the movement patterns of both eyes using the reference eye photograph and the plurality of comparison eye photos received from the imaging unit, and analyze the obstacles of the subjects of the eye evaluation subject based on the movement patterns of the both eyes. It includes a server to determine the presence,
The server,
A data storage unit for storing the reference eye photograph and the plurality of comparative eye photographs received from the imaging unit;
Map a rectangular grid to include the pupil and sclera in the reference eye photograph, extract the pupil of the reference eye photograph to which the grid is mapped, and set the center of the extracted pupil as the reference coordinate, and the pupil of the comparative eye photograph. A displacement calculation unit configured to extract and set a center of the extracted pupil as a comparative coordinate, and calculate a displacement of the pupil based on the deviation from the reference coordinate to the comparative coordinate;
After mapping a plurality of virtual lines from the center of the pupil to the outer peripheral surface of the iris in the radial direction, measuring the length of the plurality of virtual lines, and determining the iris shape based on the measured length of each virtual line, A line angle calculator configured to calculate the line angle by comparing an iris shape between a reference eye picture and the plurality of comparative eye pictures; And
Eye movement disorder evaluation system including a disability determination unit for determining the presence or absence of the disorder of the eye assessment subject based on the displacement of the pupil or the line angle.
A computer-readable storage medium having recorded thereon instructions executable by a processor for executing the method for assessing eye movement disorder according to claim 1.

Images