KR102471955B1 - Wearable neurological disease diagnosis device and the method - Google Patents

Abstract

According to the present invention, it is possible to determine whether a user has a neurological disease by visually checking eyeball images obtained in real time and observing eye movements of the user for a specific period of time.

Description

Portable neurological disease diagnosis device and its diagnosis method {WEARABLE NEUROLOGICAL DISEASE DIAGNOSIS DEVICE AND THE METHOD}

The present invention relates to a portable neurological disease diagnosis device and method for diagnosing the same, and more particularly, to a portable device for diagnosing a user's neurological disease by photographing and obtaining an optical image of light of a specific wavelength and observing changes in eye movement. It relates to a device for diagnosing neurological diseases.

With the aging of the population in modern society, the number of patients with dementia is rapidly increasing. As of 2018, the number of dementia patients in the elderly population over the age of 65 is estimated to be 700,000, and in fact, 1 in 10 elderly people suffer from dementia. In addition, it is predicted that the number of people with dementia will exceed 3 million in 2050. Considering the difficulty of dementia treatment and the resulting social cost, it has become essential to diagnose dementia early and manage symptoms.

Currently, dementia is being diagnosed through physical examination, neurological examination, psychiatric evaluation, and brain imaging examination. However, this method has difficulty in diagnosing a disease at an early stage because it can be confirmed only after suspicious symptoms appear or brain atrophy progresses.

Several years before the clinical diagnosis of dementia, it has been reported that the visuospatial function deteriorates. Recently, the possibility of early diagnosis has been suggested as a result of a study showing that the movement of the eyes of Alzheimer's patients looking at objects has a pattern different from that of normal people. Accordingly, there is a need for an eye tracker-type device capable of identifying minute tremors of the eyeball and enabling easy monitoring by the patient.

(Patent Document 1) KR 101123291 B1

A technical problem to be achieved by the present invention is a portable neurological disease diagnosis device capable of determining whether a user has a neurological disease by visually checking an eye image obtained in real time and observing the user's eye movement for a specific period of time. Its purpose is to provide

In order to achieve this object, in a portable neurological disease diagnosis device according to an embodiment of the present invention, a housing 100 that can be mounted on a user's face; and a photographing unit 200 for generating an image by photographing the user's eyeball and an optical image acquisition unit 300 that irradiates light of a specific wavelength to the user's eyeball and acquires the reflected light to generate an image; and each of the photographing unit 200 and the optical image acquisition unit 300 An image calculation unit 500 that controls operation and receives images generated from each of the photographing unit 200 and the optical image acquisition unit 300; and a user interface 800 capable of receiving the image generated by the photographing unit 200 and the optical image acquisition unit 300 from the image calculation unit 500 and transmitting the image as an image. .

In addition, the photographing unit 200 includes an eye photographing unit 210 for generating a plurality of visible light region images by photographing the user's eyeballs at predetermined time intervals for a predetermined time; and a front camera 220 that captures, in real time, the surrounding environment of the front facing the user, and converts a plurality of eyeball images generated from the eye camera 210 into images through the user interface 800. It is characterized by sending.

In addition, the optical image acquisition unit 300 includes first and second light source units respectively irradiating a plurality of lights toward the upper and lower sides based on the center of the user's eyeball;

and a light source acquisition unit 330 that senses the light emitted from the first and second light source units 310 and 320 and reflected from the eyeball and generates an image of an infrared light region. It is characterized in that the image of the eyeball is transmitted as an image through the user interface 800.

In addition, the light source acquisition unit 330 is characterized by acquiring reflected light having a wavelength between 920 nm and 1500 nm reflected from the iris including the pupil to generate an infrared light image of the eyeball.

In addition, when the light source acquisition unit 330 includes a plurality of pixels 331 detecting light reflected from the eye, and acquires image information and coordinate values from the pixels 331 detecting light reflected from the eye, It further includes a gaze point calculation unit 600 that designates the coordinate value of the pixel 331, which is the center of a plurality of coordinate values, as the center of the eyeball and the gaze point.

In addition, a reference eyeball image is received from the photographing unit 200, gaze point information calculated in correspondence with each of a plurality of infrared light images is received from the gaze point calculation unit 600, and the reference eye image and gaze point are received. It further includes an image matching unit 700 for generating a matched image by matching information.

In addition, the image matching unit 700 receives a matching image in which gaze points of the eye are displayed on the reference eye image, designates a plurality of detection areas from the center of the reference eye image, and detects the number of gaze points for each detection area. It further includes a reading unit 900 capable of reading whether or not the user has a neurological disease.

As described above, according to the present invention, the following effects can be derived.

According to one embodiment of the present invention, it is possible to easily diagnose whether or not a user has a neurological disease by visually checking an image of the eyeball obtained in real time and observing the movement or fine tremor of the user's eyeball for a specific time period. It works.

The effects of the present invention are not limited to the above effects, and should be understood to include all effects that can be inferred from the detailed description of the present invention or the configuration of the invention described in the claims.

1 is a diagram schematically showing the overall configuration of a portable neurological disease diagnosis device according to an embodiment of the present invention.
2 is a perspective view of a portable neurological disease diagnosis device according to an embodiment of the present invention.
FIG. 3 is a diagram for explaining a case where the light source acquisition unit 330 of the portable neurological disease diagnosis device according to an embodiment of the present invention detects reflected light from a pixel 331 according to eye movement.
FIG. 4 is a diagram for explaining a change in a gaze point of an eyeball along each object P1 and P2 when an object image is transmitted from the user interface 800 of a portable neurological disease diagnosis apparatus according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating a case in which visible light, an infrared light image, and a registration image of the eyeball are transmitted from the user interface 800 of the portable neurological disease diagnosis apparatus according to an embodiment of the present invention.
FIG. 6 is a diagram showing that a test start and a window for viewing diagnosis results are created when the user interface 800 of the portable neurological disease diagnosis device according to an embodiment of the present invention is executed.
FIG. 7 is a diagram illustrating a screen displayed when a test result view is executed in the user interface 800 of the portable neurological disease diagnosis apparatus according to an embodiment of the present invention.
8 is a flowchart illustrating the procedure of a portable neurological disease diagnosis method according to an embodiment of the present invention.
9 is a flowchart illustrating the procedure of the eyeball image acquisition step in the portable neurological disease diagnosis method according to an embodiment of the present invention.

1 is a diagram schematically showing the overall configuration of a portable neurological disease diagnosis device according to an embodiment of the present invention. 2 is a perspective view of a portable neurological disease diagnosis device according to an embodiment of the present invention. FIG. 3 is a diagram for explaining a case where the light source acquisition unit 330 of the portable neurological disease diagnosis device according to an embodiment of the present invention detects reflected light from a pixel 331 according to eye movement. FIG. 4 is a diagram for explaining a change in a gaze point of an eyeball along each object P1 and P2 when an object image is transmitted from the user interface 800 of a portable neurological disease diagnosis apparatus according to an embodiment of the present invention. FIG. 5 is a diagram illustrating a case in which visible light, an infrared light image, and a registration image of the eyeball are transmitted from the user interface 800 of the portable neurological disease diagnosis apparatus according to an embodiment of the present invention. FIG. 6 is a diagram showing that a test start and a window for viewing diagnosis results are created when the user interface 800 of the portable neurological disease diagnosis device according to an embodiment of the present invention is executed. FIG. 7 is a diagram illustrating a screen displayed when a test result view is executed in the user interface 800 of the portable neurological disease diagnosis apparatus according to an embodiment of the present invention. 8 is a flowchart illustrating the procedure of a portable neurological disease diagnosis method according to an embodiment of the present invention. 9 is a flowchart illustrating the procedure of the eyeball image acquisition step in the portable neurological disease diagnosis method according to an embodiment of the present invention.

A preferred embodiment of the present invention will be described in more detail with reference to the accompanying drawings, but for the sake of brevity, technical parts that have already been well-known will be omitted or compressed.

As shown in FIG. 1, the portable neurological disease diagnosis device according to an embodiment of the present invention includes a housing 100, a photographing unit 200, an optical image acquisition unit 300, a memory unit 400, a user interface ( 500), a gaze point calculation unit 600, an image matching unit 700, an image transmission unit 800, and a reading unit 900.

The housing 100 may be mounted on the user's face to be positioned in front of the eyeball. For example, the housing 100 may be formed in the form of eyeglasses or sunglasses so as to be easily mounted on a user's face.

More specifically, the housing 100 may be mounted on one side of the user's ear on both sides of the lens frame 120 and the lens frame 120 to which each of the pair of lenses 110 and the lenses 110 may be coupled in the form of eyeglasses. The first arm 121 and the second arm 122 are coupled to each other.

In this case, the first arm 121 and the second arm 122 may be hinged to the lens frame 120 in a collapsible manner.

Thus, the housing 100 can be mounted without being easily separated from the face.

The photographing unit 200 is provided in the housing 100 to photograph the user's eyeballs. The photographing unit 200 may photograph the environment in front of the user's gaze. The photographing unit 200 may be configured in plural to photograph the user's eyes and the front environment. Here, the photographing unit 200 may be formed as a pair and provided to correspond to each other in the housing 100 .

At this time, the photographing unit 200 includes an eye photographing unit 210 and a front photographing unit 220 .

The eye photographing unit 210 may photograph the user's eyes. The eyeball photographing unit 210 may photograph an eyeball to be photographed for a predetermined period of time. The eye photographing unit 210 may be, for example, a “small camera” and may perform photographing or/and recording functions.

More specifically, the eye photographing unit 210 is provided to photograph the eyeball and record the image as an image under the user's control, and may be provided on one side or the other side of the housing 100 to photograph the user's left or right eye. have.

In addition, the eye photographing unit 210 may be provided in the lens frame 120 in a state tilted at a specific angle to direct the user's eyeball. The eye photographing unit 210 may be provided on one side or the other side of the lens frame 120 so as to correspond to the position of the eye to be photographed, and it may be more preferable that the beam angle is fixed in an aligned state. have.

In this case, the eye photographing unit 210 may be provided as a pair to photograph both the left eye and the right eye of the user.

In addition, the eyeball photographing unit 210 continuously photographs the eyeball at predetermined time intervals for a predetermined time period, and the photographed eyeball image may be stored in the memory unit 400 to be followed later.

Here, when the eyeball photographing unit 210 captures the target eyeball, an eyeball image (hereinafter referred to as a reference eyeball image) is used as a comparison standard so that the eyeball in a motionless state and the eyeball in a moving state can be compared with each other. to be photographed first.

That is, the eye photographing unit 210 may capture the motion of the eyeball in a stopped state, and then photograph the motion of the eyeball at predetermined time intervals for a predetermined time period to obtain an image. At this time, the image of the eyeball acquired from the eyeball photographing unit 210 may be stored in the memory unit 400 and transmitted to the image calculation unit 500.

The front photographing unit 220 is provided in the lens frame 120 to photograph the environment in front of the user's gaze. The front capturing unit 220 may be provided in the lens frame 120 to correspond to the position of the eye capturing unit 210 . The front photographing unit 220 may be, for example, a “small camera” capable of performing photo taking and/or recording functions similarly to the eyeball photographing unit 210 .

In addition, the front camera 220 captures the front of the user's gaze in real time, and the captured front image may be transmitted to the image calculator 500 to be described later.

The optical image acquisition unit 300 may obtain an optical image of the user's eyeball by radiating light of a specific wavelength to the user's eyeball and receiving the reflected light. The optical image acquisition unit 300 may be provided in the housing 100 to irradiate a plurality of lights having wavelengths in the infrared region.

The optical image acquisition unit 300 emits light implemented as a laser beam or the like, and may generate light that can be irradiated to the eye under the control of the image calculation unit 500 .

At this time, the shape of the beam may be variously varied according to the purpose of the portable neurological disease diagnosis device of the present invention, but a laser beam may be suitable in consideration of the straightness and direction of the ordinary beam.

In addition, since a laser beam is emitted in a pulse form for a very short time or used in an infrared wavelength region, the user's eyes may not be able to see the light.

The optical image acquisition unit 300 irradiates light to the target eyeball and uses the first light source unit 310, the second light source unit 320, and the light source acquisition unit 330 to obtain an image through the reflected light. include

The first and second light source units 310 and 320 may generate and emit light having a specific wavelength. Here, the first and second light source units 310 and 320 are provided to generate and emit light of the same wavelength, but the first and second light source units 310 and 320 may generate and emit light of different wavelengths. Of course there is.

At this time, the first and second light source units 310 and 320 are provided in the lens frame 120, and the first light source unit 310 is located at an upper end of one side of the lens frame 120 and the second light source unit 320 is the lens frame ( 110) may be provided to be located at the lower end of one side. At this time, it may be more preferable that the first and second light source units 310 and 320 are provided in a state accommodated inside the lens frame 110 .

More specifically, the first and second light source units 310 and 320 generate a plurality of lights having wavelengths in the infrared range, and transmit continuous waves or pulses to the eyeball to be captured to obtain an optical image. can be investigated with The first and second light source units 310 and 320 may sequentially or simultaneously emit a plurality of lights, and the emitted light may have a wavelength range of 920 nm to 1500 nm.

In addition, a plurality of first and second light source units 310 and 320 may be provided at upper and lower ends of the lens frame 130 to irradiate a plurality of lights to the eyeball to be imaged.

In addition, when a plurality of first and second light source units 310 and 320 are provided in the lens frame 110, the first light source unit 310 emits light toward the upper side based on the center of the eyeball to be virtually photographed. investigating The second light source unit 320 radiates light toward the lower side of the eyeball based on the center of the eyeball, so that an image of the eyeball can be acquired even if the eyeball is covered by the eyelids.

At this time, light emitted from the first and second light source units 310 and 320 may be reflected on the eyeball and obtained from the light source acquisition unit 330 .

The light source acquisition unit 330 may detect light having a specific wavelength range. The light source acquisition unit 330 may acquire light reflected from the eyeball. The light source acquisition unit 330 may obtain the reflected light of the light irradiated to the eye to be photographed through the first and second light source units 310 and 320 . The light source acquisition unit 330 may generate an eyeball light image using the obtained light source.

In addition, the light source acquisition unit 330 may be provided as a pair to obtain light irradiated from the first and second light source units 310 and 320 and reflected from the eyeball.

In this case, the light source acquisition unit 330 may be located at the top and bottom of one side of the lens frame 110 and accommodated inside the lens frame 110 . When the first and second light source units 310 and 320 are formed in plurality, the light source acquisition unit 330 may be disposed between the first and second light source units 310 and 320 .

Here, the light source acquisition unit 330 acquires, for example, light emitted from the first light source unit 310 and reflected from the eye when provided at an upper end of one side of the lens frame 110, and one side of the lens frame 110. When provided at the bottom, an optical image may be generated by obtaining light emitted from the second light source unit 320 and reflected from the eyeball.

More specifically, referring to FIG. 3 , in the light source acquisition unit 330, a plurality of pixels 331 capable of detecting light of a specific wavelength may be arranged in a matrix form. Each pixel 331 may generate an optical image by receiving reflected light of light emitted from the first and second light source units 310 and 320 . Each pixel 331 may obtain incident reflected light and generate image data corresponding to the incident light.

At this time, the light source acquisition unit 330 acquires reflected light having a wavelength in the infrared region to generate a light image of the eyeball, and acquires reflected light having a wavelength between 920 nm and 1500 nm to acquire a clearer image of the iris of the eyeball. do.

Here, the light source acquisition unit 330 may generate an image of light acquired for a specific time through a plurality of pixels, and transmit image data generated for each pixel 331 to the memory unit 400 to be described later.

The memory unit 400 may receive and store information received from each unit. The memory unit 400 may include volatile and/or non-volatile memory. The memory unit 400 may receive and store images of the user's forward gaze environment and eyeballs captured by the photographing unit 200 .

Also, the memory unit 400 may store optical image data of the eyeball generated by the optical image acquisition unit 330 and may provide the stored image data to the image calculation unit 500 .

The image calculation unit 500 may obtain an image or/and an image by controlling the photographing unit 200 and the optical image acquisition unit 300, respectively. The image calculation unit 500 may transmit images or/and images acquired for a predetermined time through the photographing unit 200 and the optical image acquisition unit 300 to the user interface 800 so that the user can visually check the images.

More specifically, the image calculation unit 500 controls the operation so that the front camera 220 can capture the environment the user is watching for a predetermined time, and the image captured by the front camera 220 is captured in real time. can be delivered

In addition, the image calculation unit 500 controls the operation of the eye photographing unit 210 to acquire an image of the visible light region of the eye at a predetermined time interval for a predetermined time at the time of operation of the front photographing unit 220. In addition, the image of the eye acquired through the eye photographing unit 210 may be received.

Thereafter, the image calculation unit 500 transfers the image of the eyeball acquired from the eyeball capture unit 210 to the user interface 800, so that the image of the eyeball can be easily checked with the naked eye.

At this time, the image calculation unit 500 may control the eye capture unit 210 to be operated when the appearance of the user interface 800 is recognized in the process of receiving a photographed image through the front capture unit 220. have. For example, as shown in FIG. 4 to be described later, a user interface 800 in which an object image capable of observing a change in an eyeball gazing point is transmitted appears in front of the front camera 220, and the front camera is photographed. When the appearance of the user interface 800 is recognized through the unit 200, the image calculation unit 500 controls the operation of the eye photographing unit 220 to obtain an image of the user's target eyeball. have.

In this case, the image calculation unit 500 may obtain an eyeball image for a preset time as necessary to check the movement of the eyeball.

In addition, the image calculation unit 500 irradiates light to the eyeball through the first and second light source units 310 and 320 at the time of operation of the eyeball photographing unit 220, and the image of the eyeball obtained by the light acquisition unit 330 The optical image acquisition unit 300 is controlled to receive the optical image, and the infrared light image of the eye acquired from the optical image acquisition unit 300 is transferred to the user interface 800 and displayed.

The gaze point calculation unit 600 may detect the gaze point by analyzing eye movements. The gazing point calculation unit 600 may detect the gaze of the user's eyeball that changes according to the movement of the user's eyeball, and detect the gazing point.

More specifically, the gaze point calculation unit 600 obtains information on the light image of the eyeball generated through the light source acquisition unit 330, detects a central part of the eyeball in each light image, and determines the gaze point of the eyeball. can be specified as

In this case, when the gaze point calculation unit 600 acquires the image of the eyeball from the light source acquisition unit 330, it may also receive respective coordinate values from the pixels 331 that sense the light reflected from the eyeball.

Here, the coordinate value may be a value for a position of a pixel 331 that detects light of a specific wavelength in the light source acquisition unit 330 .

When the gaze point calculation unit 600 acquires the coordinate values of the pixels 331 for which the reflected light has been detected from the light source acquisition unit 330, the coordinate values of the central pixels among a plurality of coordinate values are the center of the eyeball and By designating it as a gaze point, it is possible to calculate gaze points corresponding to each of a plurality of optical images.

In particular, the gazing point calculation unit 600 calculates gazing points in each of the light images of the eyeball obtained at predetermined time intervals for a predetermined time period, and pixels that detect light reflected from the iris region including the pupil ( 331), it may be more desirable to designate the gaze point of the eyeball with the coordinate value of the center pixel among a plurality of coordinate values.

At this time, the gaze point calculation unit 600 transmits the calculated gaze point information to the image matching unit 700, which can be visually confirmed through the user interface 800.

The image matching unit 700 may acquire multiple images and display them as one screen on the screen of the user interface 800 . The image matching unit 700 may match the reference eyeball image received from the image calculation unit 500 with the gaze point received from the gaze point calculation unit 600 .

For example, when the image matching unit 700 matches the gaze point of the eyeball calculated through the gaze point calculation unit 600 on the reference eye image, the gaze point of the eye is a circular point having a predetermined size. ) can be expressed as

At this time, the plurality of gazing points displayed on the reference eyeball image have mutually different colors according to the time calculated through the gazing point calculation unit 600, and gazing points at similar or identical positions may overlap each other and be displayed. have. The matched image may be transmitted through the user interface 800 .

Therefore, the image matching unit 700 plays a role of generating a matched image by matching the gaze point information with the reference eye image so that the gaze point of the eye calculated through the gaze point calculation unit 600 can be displayed on the reference eye image. that can be done

The user interface 800 receives an input for operation of the photographing unit 200 and the optical image acquisition unit 300 from a user, and acquires an eyeball image or registration from the photographing unit 200 and the optical image acquisition unit 300. outputs the image as a video. The user interface 800 may include buttons, keypads, switches, dials, or touch interfaces for a user to directly manipulate operations of the photographing unit 200 and the optical image acquisition unit 300 . The user interface 800 may include a screen for transmitting an image and may be implemented as a touch screen. For example, the user interface 800 may receive a touch, gesture, proximity, or hovering input using an electronic pen or a user's body part.

In addition, the user interface 800 may display various contents (eg, text, image, video, icon, and/or symbol) to the user.

Referring to FIG. 5 , the user interface 800 is electrically connected to the image calculation unit 500, and a visible light image of the eye acquired through the eye photographing unit 220 in a divided state on a screen and the image calculation unit The infrared optical image of the eyeball received from 500 and the matched image received from image matcher 700 may be transmitted respectively.

At this time, the user interface 800 can transmit the image by continuously transmitting the captured image of the eyeball and the light image obtained at a predetermined time interval for a predetermined time according to the image acquisition time.

In addition, the user interface 800 may transmit the captured image of the eyeball, the light image, and the matched image in a divided manner on the screen, but only one image may be transmitted on the screen, and an image to be transmitted on the screen may be selected by a separate operation. can

Also, referring to FIG. 6 , when the user interface 800 is executed, a screen displaying “start diagnosis” and “view diagnosis result” windows appears. Each of the “Start Diagnosis” and “View Diagnosis Result” windows may display corresponding screens when an execution input such as a user's touch is acquired.

That is, when the user interface 800 obtains an execution input for “diagnosis start”, a screen as shown in FIG. 4 appears and a detailed description will be given later. In addition, the user interface 800 displays reading information on whether or not a neurological disease is possessed through a reading unit , as shown in FIG. this may appear.

Here, the user interface 800 can observe a change in the gaze point of the eyeball in the process of calculating the gaze point of the eyeball through the gaze point calculation unit ( ) when an execution input for “diagnosis start” is obtained by the user. It is possible to transmit object images that can be transmitted.

Referring to FIG. 4 , the user interface 800 repeatedly displays a first object P1 and a second object P2 left and right at a preset time interval during a preset time on the screen to move the eyeballs. Object images can be transmitted. In this case, the first and second objects P1 and P2 may be displayed on the screen of the user interface 800 in a flickering manner.

For example, when the user interface 800 transmits an object image so as to calculate the gaze point of the eyeball by moving the eyeball, as shown in FIG. 4(a), the first object P1 is displayed on the screen. It is displayed on the left side of the image for a predetermined time, and after the display time of the first object P1 has passed, the display of the first object P1 is released. After a predetermined time interval, as shown in (b) of FIG. 4 , the second object P2 may be displayed for a predetermined time. In addition, after the display time of the second object P2 has elapsed, the display of the second object P2 may be canceled, and after a preset time interval, the first object P1 may be displayed again for a preset time.

Here, by transmitting object images to display the first and second objects P1 and P2 that the eyes can gaze at alternately on the screen through the user interface 800, respectively, the eye gaze point can be more efficiently change can be observed.

At this time, when an object image is transmitted from the user interface 800 and a matched image is generated by the image matching unit 700 as the user gazes at the transmitted object image and moves his or her eyes, the reading unit 900 transmits the object image. Neurological disorders can be diagnosed.

The reading unit 900 may read whether or not a person has a neurological disease through the matching image generated by the image matching unit 700 . The reading unit 900 may receive a matched image in which gaze points of the eye are displayed on the reference eye image from the image matching unit 700 and determine the degree to which gaze points are distributed in each region among a plurality of regions.

At this time, the reading unit 900 can detect whether or not the user has a neurological disease by detecting the number of gaze points distributed in each region and comparing the number of gaze points in each region. Here, the neurological disease may be, for example, Alzheimer's disease or dementia.

Referring to FIG. 7 , the reading unit 900 displays, for example, a plurality of trajectories spaced apart from the center of the eyeball on a reference eyeball image, detects the number of gaze points existing in each trajectory, and detects By comparing the number of gaze points, it is possible to determine whether a person has a neurological disease.

At this time, a detection area is formed corresponding to the plurality of traces, and the plurality of traces may be formed in a circular shape with a diameter gradually increasing at regular intervals.

Here, the plurality of detection areas include a first detection area A1 for an area within the first trajectory, a second detection area A2 for an area between the first and second trajectories, and a third area between the second and third trajectories. By designating 3 detection areas and setting the first detection area as 'normal range', the second detection area as 'suspicious range', and the third detection area as 'risk range' for each detection area, gaze points distributed for each area Depending on the degree of the number of , it is possible to read whether or not you have a neurological disease.

Therefore, the reading unit 900 detects and compares the number of gaze points for each detection area, and displays at least one display phrase among 'normal range', 'suspicious range', and 'risk range' on the user interface 800. By doing so, it is possible to determine the extent of the disease as well as whether or not there is a neurological disease.

Hereinafter, with reference to FIG. 8 , the operational flow of the portable neurological disease diagnosis device according to an embodiment of the present invention and a method for diagnosing a neurological disease will be described in detail.

8 is a flowchart illustrating the procedure of a portable neurological disease diagnosis method according to an embodiment of the present invention.

Referring to FIG. 8, the portable neurological disease diagnosis method (S10) is for operating the photographing unit 200 and the optical image acquisition unit 300 through the user interface 800 while the housing 100 is mounted on the face. It may include an operation input acquisition step (S100) of acquiring input information.

For example, the operation input acquisition step ( S100 ) includes operating time of the eye photographing unit 210 and time interval information for obtaining an eyeball image from the user, operating time information of the front photographing unit 220 , first and second light source units Input information about operations of the photographing unit 200 and the optical image acquisition unit 300, such as operation time information of 310 and 320 and the light source acquisition unit 330, may be obtained. In addition, transmission time information of object images transmitted from the user interface 800 may also be included.

The portable neurological disease diagnosis method ( S10 ) may include an anterior surrounding environment image acquisition step ( S200 ) of obtaining a real-time image of the surrounding environment in front of the user through the operation of the front imaging unit 220 . The front surrounding environment image acquisition step ( S200 ) may be performed by the front camera 220 .

In the portable neurological disease diagnosis method (S10), when operation input information for the photographing unit is obtained in the operation input acquisition step (S200), a reference eye image is acquired to obtain a reference eye image in a stationary state of an eyeball to be captured. Step S300 may be included. The step of obtaining a reference eyeball image ( S300 ) may be performed by the eyeball photographing unit 210 .

The portable neurological disease diagnosis method (S10) may include an eyeball image acquisition step (S400) of photographing an eyeball to be photographed and acquiring a visible light image and an infrared light image of the photographed eyeball in the process of changing the movement of the eyeball. have.

Referring to FIG. 9 , the eyeball image acquisition step (S400) includes a user interface recognition step (S410), examination start input information acquisition step (S420), eyeball visible light image acquisition step (S430), and eyeball infrared light image acquisition step (S420). S440) may be included.

In the eyeball image acquisition step (S400), the user interface recognition step (S410) is performed by the front capture unit 220 so that image information in which the user interface 800 appears through the front capture unit 220 is transmitted to the image calculation unit ( ). The user interface 800 may appear forward, and the appearance of the user interface 800 may be determined from image information photographed from the front photographing unit 220 through the image calculation unit 500 . At this time, when the appearance of the user interface 800 is recognized through the image calculation unit 500, a test start input information acquisition step (S420) is performed.

Here, the appearance of the user interface 800 in a state in which the windows “start test” and “view test results” are displayed on the screen of the user interface 800 is recognized.

In the test start input information acquisition step (S420), after the image calculator 500 recognizes the appearance of the user interface 800 and obtains input information about “start test” from the user, the screen of the user interface 800 Object images can be transmitted over the image. As described above, the object image may be an image in which the first and second objects P1 and P2 are alternately displayed left and right, respectively.

In the step of obtaining a visible light image of the eyeball (S430), the object image is transmitted from the user interface 800, and the eyeball moving along the alternately displayed first and second objects P1 and P2 is photographed to obtain an eyeball image in the visible light region. can be obtained

At this time, in the eyeball image acquisition step (S400), together with the eyeball visible light image acquisition step (S430), the first and second light source units 310 and 320 radiate light to the target eyeball, and the light source acquisition unit 330 An infrared light image acquisition step ( S440 ) of the eyeball may be performed in which reflected light reflected from the iris including the pupil among the lights irradiated to the eyeball is acquired as an eyeball image in the infrared light region.

Thereafter, in the portable neurological disease diagnosis method (S10), in the process of obtaining an infrared light image of the eyeball, gaze point calculation unit 600 calculates a gaze point corresponding to each of a plurality of infrared light images through the gaze point calculation unit 600. Step S500 may be included.

The portable neurological disease diagnosis method (S10) receives the reference eye image transmitted from the image calculation unit 500 and gaze point information of the eye from the gaze point calculation unit 600 so that the gaze point information can be displayed on the reference eye image. An image matching step (S600) of generating a matched image by matching the reference eyeball image and gaze point information may be included.

The portable neurological disease diagnosis method (S10) is an eye image transmission step capable of transmitting visible light and infrared light images of the eye and a matched image of the eye from the image calculation unit 500 and the image matching unit through the user interface 800 as an image. (S700) may be included. Among the images transmitted in the eyeball image transmission step (S700), the captured visible and infrared light images of the eye are continuously transmitted according to the image acquisition time, respectively.

In the portable neurological disease diagnosis method (S10), when input information for “viewing diagnosis results” is obtained from the user, information read through the reader 900 whether or not a kidney disease is present is transmitted from the screen of the user interface 800. A neurological disease diagnosis result calculation step (S800) may be included. In the neurological disease diagnosis result calculation step (S800), a phrase according to reading information corresponding to at least one of 'normal range', 'suspect range', and 'risk range' is displayed on the 'view diagnosis result' screen of the user interface 800. can make it possible

Therefore, in the portable neurological disease diagnosis device according to the present invention, when the examination is in progress, the first object (P1) or the second object (P2) displayed alternately among the object images is gazed at for a specific time. When gazing at any one of the still objects P1) or the second object P2, it is possible to easily diagnose whether or not the user has a neurological disease by observing eye movement or micro-tremors.

100: housing 200: shooting unit
300: optical image acquisition unit 400: memory unit
500: image calculation unit 600: gaze point calculation unit
700: image matching unit 800: user interface
900; reader

Claims (7)

A housing 100 that can be mounted on a user's face; and
A photographing unit 200 for generating an image by photographing the user's eyeball; and
An optical image acquisition unit 300 for generating an image by irradiating light of a specific wavelength to the user's eyeball and acquiring reflected light;
An image calculation unit 500 that controls operations of the photographing unit 200 and the optical image acquisition unit 300 and receives images generated by the photographing unit 200 and the optical image acquisition unit 300, respectively. ); and
A user interface 800 capable of receiving an image generated by the photographing unit 200 and the optical image acquisition unit 300 from the image calculation unit 500 and outputting the image as an image;
The optical image acquisition unit 300 includes first and second light source units respectively irradiating a plurality of lights toward the upper and lower sides based on the center of the user's eyeball;
A light source acquisition unit 330 detects light emitted from the first and second light source units 310 and 320 and reflected from the eyeball to generate an image of an infrared light region,
The eyeball image generated by the light source acquisition unit 330 is transmitted as an image through the user interface 800,
The light source acquisition unit 330 includes a plurality of pixels 331 for detecting light reflected from the eye,
When obtaining coordinate values along with image information from the pixel 331 detecting reflected light from the eyeball, gaze point designating the coordinate value of the pixel 331 as the center of a plurality of coordinate values as the center of the eyeball and gaze point. Portable neurological disease diagnosis device characterized in that it further comprises a calculator (600).
According to claim 1,

The photographing unit 200 includes an eye photographing unit 210 for generating a plurality of visible light region images by photographing the user's eyeballs at predetermined time intervals for a predetermined time; and
Including; a front camera 220 for capturing the surrounding environment in front of the user in real time;

A portable neurological disease diagnosis device, characterized in that for transmitting a plurality of eyeball images generated by the eyeball photographing unit 210 as images through the user interface 800.
delete According to claim 1,

The light source acquisition unit 330 acquires reflected light having a wavelength between 920 nm and 1500 nm reflected from the iris including the pupil to generate an infrared light image of the eyeball.
delete According to claim 1,

The reference eyeball image is received from the photographing unit 200, the gazepoint information calculated in correspondence with each of the plurality of infrared light images is received from the gazepoint calculation unit 600, and the reference eyeball image and gazepoint information are obtained. A portable neurological disease diagnosis device, characterized in that it further comprises an image matching unit (700) for generating a matched image by matching.
According to claim 6,

The image matching unit 700 receives a matched image in which gaze points of the eye are displayed on the reference eye image, designates a plurality of detection areas from the center of the reference eye image, and detects the number of gaze points for each detection area. Further comprising a reading unit 900 capable of reading whether or not a neurological disease is present,

The reading unit 900 receives a matched image in which the gaze points of the eye are displayed on the reference eye image from the image matching unit 700, and gaze points are distributed in each region among a plurality of regions.

Images