JP2005143599A - Line-of-sight display device and dementia diagnostic device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a line-of-sight display device and a dementia diagnostic device capable of surely making a copy subject graphic and line-of-sight data correspond and analyzing the track of a copied graphic and an eyeball movement without generating distortions in camera images. <P>SOLUTION: The line-of-sight display device 3 displays the copy subject graphic to be an object to be copied to a viewer, superimposes track data which are the track that the viewer copies the copy subject graphic and the line-of-sight data which are the movement of the line of sight obtained by photographing the eyeball of the viewer at the time of copying the copy subject graphic, on the copy subject graphic and displays them. The line-of-sight display device 3 is provided with a copy subject graphic data recording means 9, a copy subject graphic data display means 7, a track data acquisition means 7b, an infrared camera 5c, a line-of-sight data calculation means 5e, and a line-of-sight copy track display means 10. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a gaze display device that displays gaze data obtained by drawing a gaze from the movement of an eyeball, and a dementia diagnosis device that diagnoses dementia based on the gaze data.

  Conventionally, the Hasegawa simple intellectual function examination scale has been frequently used in the diagnosis of dementia. In this Hasegawa simple intellectual function examination scale, a simple question (for example, asking today's date, showing the names of multiple items in a row, hiding one of them, hiding one of them, The degree of dementia (dementia degree) is obtained from the evaluation value obtained by evaluating the answer to this question.

  However, patients with so-called Alzheimer-type dementia (hereinafter referred to as AD patients) can often answer simple questions on the Hasegawa-style simplified intellectual function examination scale in the initial stage of symptoms. The reason is that in AD patients, selective damage occurs only in the parietal lobe of the brain, which is said to be responsible for spatial vision, in the initial stage. The test site of the brain is different, and a correct evaluation value cannot be obtained for a subject suspected of having Alzheimer-type dementia, and the degree of dementia of the subject may not be accurately measured.

  In addition, for the same reason, in AD patients, symptoms such as so-called disorientation occur such as getting lost or not knowing where to put things, but in the evaluation by the Hasegawa simple intellectual function examination scale, Good results may be obtained. For this reason, in the Hasegawa simple intellectual function examination scale, a subject suspected of having Alzheimer-type dementia may not be diagnosed as having the dementia.

  For this reason, conventionally, for the diagnosis of subjects suspected of having Alzheimer-type dementia, in order to examine the function of the brain related to spatial vision, a given figure is copied and a judgment is made based on the copied copied figure. A graphic replication inspection is often performed. In this graphic reproduction inspection, typical figures (original figure, replication task graphic) presented to AD patients are simple line drawings such as cubes and flowers. In the graphic reproduction inspection, the line drawing is displayed on the right side of the sketch book. It is presented on (left side) and copied to the left side (right side) of the sketch book (makes a copied figure to be drawn).

  In this graphic replication test, the patient is diagnosed with AD (suspected Alzheimer-type dementia, symptom is progressing) based on the test result that the copied graphic becomes young or cannot be copied at all. Is done. However, similar test results may also appear in patients with cerebrovascular dementia (hereinafter referred to as MID patients) who develop a stroke or cerebral infarction at a specific site in the brain.

  Since the cause of the disease is completely different between AD patients and MID patients, the treatment methods are also different, and misdiagnosis at the time of diagnosis is not allowed. Therefore, for subjects suspected of having Alzheimer-type dementia, the movement of the line of sight (calculated from eye movements) is observed together with the copied figure at the time of the figure copying examination (line-of-sight detection). To make a distinction. That is, the movement of the line of sight of a subject suspected of having Alzheimer-type dementia has characteristics (notable differences) as shown in items (1) to (5) described below.

  (1) As shown in FIG. 11, when a figure is copied, the eye movement (reciprocating eye movement) that reciprocates between the original figure (solid cross) and the copied figure is less than that of a healthy person. . (2) As shown in FIG. 12, in the example in which the reciprocating eye movement is observed, the position of the gazing point on the original figure (flower) does not correspond to the position of the gazing point on the copied figure.

(3) As shown in FIG. 13, a component with particularly small amplitude called saccade out of eye movements swarms and the line of sight concentrates locally or deviates from the original figure or the copied figure.
(4) As shown in FIG. 14, the gazing point on the original figure (triangle) is not seen, and the “Closing in phenomenon” (closing phenomenon) is seen.

  (5) FIG. 15 shows a case where the original figure (flower) is “traced” from above, but an AD patient can accurately trace the original figure, but the number of gazing points is normal. Compared to the gazing point, the gazing point is densely distributed in the center of the original figure. In addition, the time required to trace the original figure also increases compared to the time required for healthy persons.

  Attempts have been made to clarify the distinction from MID patients by utilizing the fact that unique findings such as (1) to (5) are obtained in AD patients (see Non-Patent Document 1). .

  Conventionally, in the case of performing a graphic replication inspection including such a line-of-sight detection, an example of a hollow cross-shaped original graphic (simulated task graphic) shown on the left side of FIG. 11 or the left side of FIG. As shown in the example of the original cube figure (simulated task figure) shown, hand the paper with the original figure (simulated task figure) to a subject suspected of having Alzheimer-type dementia, A copied figure (an example of the copied figure shown on the right side of FIG. 11 and an example of the copied figure shown on the right side of FIG. 16) is drawn.

  In addition, when performing a graphic reproduction inspection including this gaze detection, the goggles shown in FIG. 17 are previously attached to a subject suspected of having Alzheimer-type dementia. In the goggles 101 shown in FIG. 17, the eye movement detection sensor 103 that measures the movement of the line of sight from the movement of the eyeball's black eye position (eye movement) and the paper on which the original figure (simulation task figure) is written are photographed. A field-of-view camera 105 is attached to the goggle main body 101a.

The display device (not shown) analyzes the line-of-sight data detected by the eye movement detection sensor 103 and analyzed from the eye movement when drawing the copied figure on the camera image taken by the visual field camera 105 attached to the goggle main body 101a. ) Is superimposed on the display screen.
An expert (doctor) looks at the display screen of this display device (not shown) and diagnoses based on whether or not eye movements specific to AD patients are observed.

  In the goggles 101, the eye movement of the subject is detected by a method (principle) called a scleral reflection method, which is one of general eye movement detection methods. There are various types of eye movement detection methods, and since there is no great difference in the detection of eye movements, any method may be used. Here, with reference to FIG. 18, the detection principle of the eye movement by the scleral reflection method will be described.

  As shown in FIG. 18 (a), the eyeball is composed of a so-called white eye portion, that is, the sclera, and a black eye portion, that is, the cornea (pupil portion). The white eye portion and the black eye portion have different light reflectivities. Compared with the white eye portion having a high reflectivity, the black eye portion has a lower reflectivity, and the light is almost absorbed and not reflected. . Therefore, in the scleral reflection method, weak infrared light, which is invisible light, is emitted from the infrared LED, irradiated to the eyeball, and the change in the amount of reflected light accompanying the movement of the eyeball is detected using a photodiode with infrared sensitivity. doing. That is, from the difference in light reflectance between the white-eye portion and the black-eye portion, the reflected light amount of the white-eye portion is strong (large), and the reflected light amount of the black-eye portion is weak (small).

  Therefore, when detecting the momentum (movement amount) of the eye movement in the horizontal direction, as shown in FIG. 18B, one photodiode is arranged at a position where both sides of the black eye portion are detected. In addition, a difference signal indicating the difference between the amounts of reflected light detected by these two photodiodes is used. That is, in FIG. 18B, when eye movement occurs in the right direction toward the right, the black eye portion is shifted to the right, the amount of reflected light detected by the left photodiode increases, and is detected by the right photodiode. The amount of reflected light decreases. As a result, when the difference in the amount of reflected light is taken by an operational amplifier or the like, a difference signal is detected as a positive voltage. Conversely, when eye movement occurs in the left direction, a differential signal is detected as a negative voltage. Since the magnitude of the difference signal is proportional to the amount of movement (movement amount), the amount of eye movement in the horizontal direction can be detected based on the sign of the difference signal.

In addition, when detecting the amount of movement (movement amount) of the eye movement in the vertical direction, as shown in FIG. 18 (c), one photo is taken at a position where the lower left side and the lower right side of the black eye portion are detected. A diode is disposed, and a sum signal indicating the sum of reflected light amounts detected by these two photodiodes is used. That is, in FIG. 18C, when eye movement occurs in the upward direction in the drawing, the white eye part is completely exposed from the lower eyelid, and the amount of reflected light detected by each photodiode increases. As a result, when the sum of the reflected light amounts is taken by an operational amplifier or the like, an increased sum signal is detected. Conversely, if eye movement occurs in the downward direction in the figure, the portion of the black eye that occupies the lower eyelid increases according to the amount of movement (movement amount), and the amount of reflected light detected by the photodiode decreases, resulting in a reduced sum. A signal is detected. As a result, the magnitude of the sum signal is proportional to the up and down momentum (movement amount), so that the momentum of the eye movement in the vertical direction can be detected. The reason why the two photodiodes are arranged on the left and right sides of the lower eyelid is to detect not only the front but also the eye movement in the vertical direction when gazing in the horizontal direction.
Mitsuru Fujii Visual cognitive impairment in Alzheimer's disease Analysis by Vision analyzer, Hokkaido Dementia Study Group, pp47-50 (July 1989)

  However, in the conventional graphic replication inspection including gaze detection, the visual camera 105 attached to the goggle main body 101a attached to a subject suspected of having Alzheimer-type dementia is the paper on which the original graphic (simulated task graphic) is written. An image was taken and the line-of-sight data obtained by analyzing the line of sight from the eye movement detected by the eye movement detection sensor 103 was superimposed on the photographed camera image and displayed on another display device (not shown).

  In this case, each time the subject's posture (head position) changes, the captured camera image moves (blurs), and the correspondence between the original figure (simulated task figure) reflected in the camera image and the line-of-sight data There is a problem that cannot be removed.

  Further, even if the distance between the visual field camera 105 and the paper on which the original figure (simulated task graphic) is written is short, the change in the posture of the subject is small, and the movement of the photographed camera image is small. Since the overhead angle of the camera 105 is large, there is a problem in the captured camera image that distortion occurs between the upper part and the lower part of the paper on which the original figure (simulated task figure) is written.

  Furthermore, in the conventional figure replication inspection including gaze detection, paper was used as the medium for drawing the copied figure, so the movement of the subject's pen (when the copied figure was copied) (Trajectory, temporal transition) and eye movement cannot be analyzed step by step.

  Therefore, in the present invention, when performing the graphic replication inspection including gaze detection, the above-mentioned problems can be solved, and the replication task graphic and the gaze data can be reliably associated with each other and attached to the goggle main body 101a attached to the subject. Based on the line-of-sight display device that can analyze the locus of the copied figure and the eye movement without causing distortion in the camera image as taken by the field-of-view camera 105, and the output result of this line-of-sight display device, It is an object of the present invention to provide a dementia diagnosis apparatus for diagnosing whether or not a subject has dementia.

  In order to solve the above-mentioned problem, the line-of-sight display device according to claim 1 displays a copying task graphic to be copied to a viewer, and a track that is a track of the copying of the copying task graphic by the viewer. A line-of-sight display device that displays the data and the line-of-sight data, which is the line-of-sight movement obtained by measuring the movement of the eyeball of the viewer when copying the replication task graphic, overlaid on the replication task graphic Thus, a copying task graphic data recording unit, a copying task graphic data display unit, a trajectory data acquisition unit, an eye movement measurement unit, and a line-of-sight data calculation unit are provided.

  According to this configuration, the line-of-sight display device displays the copy task graphic based on the copy task graphic data recorded in the copy task graphic data recording unit by the copy task graphic data display unit. A trajectory copied by the viewer (subject) while watching is acquired as trajectory data by trajectory data acquisition means. The line-of-sight display device acquires the trajectory data copied by the viewer by the trajectory data acquisition means, and at the same time, the movement of the eyeball when the viewer copies the copy task figure while looking at the copy task figure (Eye movement) is measured by the eye movement measuring means, and line-of-sight data indicating the movement of the line of sight of the viewer is calculated by the line-of-sight data calculating means based on the measurement result.

  Note that the viewer (subject) may trace the copy task figure directly, and in this case, the trace data acquisition means acquires “trace data” instead of the trace data. For the calculation of the line-of-sight data, an eye movement detection sensor 103 such as a scleral reflection system attached to the goggles 101 described in FIG. 17 or a system in which an eye movement of an observer is photographed with a television camera and measured by image processing. Various methods can be used. In the latter method of shooting with a television camera, not only from direct eye movement (eye movement), but also the center of the cornea (black eye) of the eyeball taken by the imaging means, that is, the center of the pupil and the reflected light spot Therefore, the movement of the line of sight in space is obtained by combining the relative eye movements caused by the movement of the body and head. In addition, when detecting the movement of the line of sight by the scleral reflection method, the movement of the line of sight due to the head movement is separately detected by a magnetic sensor or the like. Alternatively, a method of fixing the head movement with a chin stand or the like has been put into practical use. For example, in this line-of-sight display device, after the viewer draws the locus of the copying task graphic, the locus data and the line-of-sight data can be displayed superimposed on the copying task graphic by the copying task graphic data display means.

  The line-of-sight display device according to claim 2 is the line-of-sight display device according to claim 1, wherein the eye movement measurement means is arranged on the display surface side of the copy task graphic data display means when acquiring the locus data. The eye-gaze data is calculated by the eye-gaze data calculating means on the basis of an eyeball image that is an image of the eyeball of the viewer taken by the image-taking means. The locus data and the line-of-sight data are superimposed and displayed on the replication subject graphic by the line-of-sight replication locus display means.

  According to such a configuration, the line-of-sight display device configures the eye movement measurement unit as the imaging unit, and calculates the line-of-sight data by the line-of-sight data calculation unit based on the eyeball image of the viewer imaged by the imaging unit. Then, the line-of-sight replication trace display means displays the trace data and the line-of-sight data superimposed on the replication task graphic.

  Here, since the trajectory data acquisition means and the photographing means are arranged on the display surface side of the copying task graphic data display means, there is no need for the viewer to wear goggles as in the past, and the viewer It is possible to perform the copying while viewing the copying task figure without being restricted in posture, and at the same time, it is possible to shoot the movement of the eyeball when copying by the shooting means. The trajectory data acquisition means incorporates, for example, a pressure sensor for detecting the writing pressure when the viewer uses the writing instrument to copy the copying task figure, and a transmitting means for transmitting ultrasonic waves to the writing instrument in advance. In addition, it can be realized by an ultrasonic sensor or the like for detecting the ultrasonic wave transmitted by the transmitting means. For example, this line-of-sight display device can display the trajectory data superimposed on the copying task graphic by the copying task graphic data display means.

  The line-of-sight display device according to claim 3 is the line-of-sight display device according to claim 2, comprising two of the photographing means, and the right and left edges of the casing surrounding the display surface of the copying subject graphic data display means, A photographing lens for the photographing means is provided, respectively.

  According to such a configuration, the line-of-sight display device is provided with the photographing lenses of the photographing means on both the left and right edges (left edge and right edge) of the casing surrounding the display surface of the copy task graphic data display means. Thus, the viewer does not need to wear goggles, and the viewer can copy while viewing the copy task figure without being restricted in posture, and at the same time, it can be copied by the photographing means. The movement of the eyeball during the shooting can be taken.

  In the case where the copying task graphic data display means, the trajectory data acquisition means and the photographing means are integrated, for example, it can be realized by using a touch panel display device, and the left of the viewer facing the photographing means provided on the left edge. A wide range of eye movements without distortion by taking an eye image related to the eye movement of the visual field and taking an eye image related to the eye movement of the right visual field of the viewer facing the imaging means provided on the right edge. Can be obtained. Note that the eye-gaze data can be calculated by the eye-gaze data calculating means if at least one eyeball image taken by the image-taking means is present. When only one of the eyeball images obtained by the two photographing means is used, the range in which the eye movement can be detected is smaller than when both eyeball images are used.

  The line-of-sight display device according to claim 4 is the line-of-sight display device according to claim 2, wherein the trajectory data acquisition means is configured as a transmissive touch panel, and a visible light reflective coating is provided on a display surface side of the copying subject graphic data display means. The transmission type touch panel includes: a half mirror that has been subjected to a treatment and an infrared light transmission coating process; and an infrared light irradiation unit that irradiates infrared light, and the reflection subject figure is reflected on a reflection surface of the half mirror. And the photographing means and the infrared light irradiation means are provided on the back surface of the half mirror.

  According to such a configuration, the line-of-sight display device displays the copy task graphic displayed on the copy task graphic data display means on the screen surface of the transmissive touch panel via the half mirror, and the view facing the transmissive touch panel. On the face (eyeball) of the viewer, the infrared light irradiated and reflected by the infrared light irradiation means is photographed by the photographing means provided on the back surface of the half mirror. In other words, the half mirror reflects visible light by the visible light reflecting coating process applied to the half mirror, whereas it transmits infrared light by the infrared light transmitting coating process.

  The line-of-sight display apparatus according to claim 5 is the line-of-sight display apparatus according to any one of claims 1 to 4, further comprising line-of-sight replication locus display means for displaying the locus data and the line-of-sight data in a superimposed manner. It is characterized by that.

  According to this configuration, the line-of-sight display device displays the locus data and the line-of-sight data in an overlapping manner on the copying subject graphic by the line-of-sight copying locus display means. In other words, by providing a gaze copying locus display means separately from the copying task figure data display means, even when the viewer is copying the copying task figure, the trajectory data acquired so far and the calculated line of sight Data can be displayed overlaid.

  The dementia diagnosing device according to claim 6 displays a replication task figure to be copied to a viewer, locus data that is a locus of the replication task graphic copied by the viewer, and the replication task. Dementia diagnosis for diagnosing whether or not the viewer has dementia based on the eye-gaze data obtained by measuring the eye movement of the viewer when copying the figure The apparatus includes a visual line display device, a reference visual line pattern recording unit, and a diagnostic unit.

  According to this configuration, the dementia diagnosing device uses the reference means as a reference for the movement of the sight line indicating the symptoms of dementia, the trajectory data output from the sight line display device, and the copy task graphic data by the diagnostic unit. Based on the result of comparison between at least one of the above and the line-of-sight data output from the line-of-sight display device, it is diagnosed whether or not the patient has dementia (Alzheimer-type dementia). In addition to the reference line-of-sight pattern, which is the movement of the line of sight associated with the replication task graphic, a reference trajectory pattern that is a locus associated with the replication task graphic (a group of lines when copied to a different location from the replication task graphic) Alternatively, a comparison operation may be performed with a reference tracing pattern which is a tracing line (a line group when tracing the copying task figure) associated with the copying task figure.

  The dementia diagnosis apparatus according to claim 7 is the dementia diagnosis apparatus according to claim 6, wherein the line-of-sight display device, the reference line-of-sight pattern recording unit, and the diagnosis unit are connected via a communication unit. Features.

  According to such a configuration, the dementia diagnosing device includes a gaze display device, a reference gaze pattern recording unit, and a diagnostic unit that are connected via a communication unit such as a network. Can be diagnosed even if the viewer is at a remote location.

  According to the first aspect of the present invention, the line-of-sight data is calculated by the line-of-sight data calculating means, and the line-of-sight data is displayed on the copying task graphic by the copying task graphic data display means. The line-of-sight data can be reliably associated. In other words, unlike the conventional case, when performing a graphic replication inspection including eye gaze detection, since the paper surface is not photographed using a field of view camera attached to goggles, there is no distortion in the output result image. . Further, if the trajectory data and the line-of-sight data are used, it is possible to analyze the relevance between the trajectory and the eye movement when the copying task graphic is copied.

  According to the second aspect of the present invention, an eyeball image is photographed by the photographing means, and the line-of-sight data is calculated by the line-of-sight data calculation means based on the eyeball image, and the line-of-sight data is displayed by the copying subject graphic data display means. Since the data is displayed so as to be superimposed on the copying task figure, the copying task figure and the line-of-sight data can be reliably associated with each other.

  According to the third aspect of the present invention, since the photographing lens of the photographing means is provided in the casing surrounding the display surface of the copying subject graphic data display means, it is necessary for the viewer to wear goggles as in the past. In addition, the viewer can perform the copying while viewing the copying task figure without being restricted in posture, and at the same time, it is possible to shoot the movement of the eyeball when copying with the shooting means. it can.

  According to the invention described in claim 4, the copy task graphic displayed on the copy task graphic data display means is displayed on the screen surface of the transmissive touch panel by the visible light reflecting coating applied to the half mirror, Infrared light reflected on the face (eyeball) of the viewer facing this transmissive touch panel by the infrared light transmitting coating applied to the half mirror. Since the image is taken by the photographing means provided on the back of the screen, when the viewer copies (traces) the copying task graphic, the transmissive touch panel on which the copying task graphic is displayed is watched. Even if the person slightly moves his / her body or head, the eyeball of the viewer can be reliably photographed.

  According to the fifth aspect of the present invention, the trajectory data and the calculated line-of-sight data acquired so far are displayed on the copy task graphic while the viewer is copying the copy task graphic. Can be made.

  According to the sixth aspect of the present invention, the place where the doctor diagnoses by looking at the output result of the line-of-sight display device, the line-of-sight data as the output result of the line-of-sight display device, and the reference line-of-sight pattern recorded in advance By comparing and calculating, it is possible to diagnose whether or not the viewer has dementia (Alzheimer-type dementia) by the diagnostic means.

  According to the seventh aspect of the present invention, the output result of the line-of-sight display device is transmitted via the communication means, so that even if the viewer is at a remote place, the viewer is not dementia (Alzheimer's). Type dementia) can be diagnosed.

Embodiments of the present invention will be described in detail with reference to the drawings as appropriate.
(Configuration of dementia diagnosis device)
FIG. 1 is a block diagram of a dementia diagnosis apparatus. As shown in FIG. 1, the dementia diagnosing device 1 performs a graphic reproduction inspection including gaze detection on a subject (viewer) to determine whether or not the subject has dementia, particularly Alzheimer-type dementia. The visual line display device 3, the control means 11, the diagnostic means 13, the reference visual line pattern recording means 15, the reference trajectory pattern recording means 17, the reference trace pattern recording means 19, and the intelligent function test Data recording means 21.

  In the dementia diagnosis device 1, the subject copies the copy task graphic (writes in another place) or traces the copy task graphic (directly overwriting the copy task graphic) in the graphic copy inspection including gaze detection. The movement of the line of sight is detected. The line of sight is realized by a combination of eye movements (direct eye movements) and relative eye movements caused by body and head movements. However, in psychological experiments, etc., if the relative eye movement that occurs with the movement of the body or head is added, analysis becomes difficult. Usually, the movement of the head is fixed with a chin stand etc. Often only detected. In this dementia diagnosing device 1, the gaze display device 3 shoots the face of the subject and uses a gaze detection method (details will be described later) that does not require the subject to be fixed on the chin stand. It also detects the relative eye movement that occurs with the movement of the eye. The line-of-sight detection method is not limited to this embodiment, and various methods that are currently commercialized can be used.

  The dementia diagnosing device 1 uses the intelligent function test data recorded in the intelligent function test data recording means 21 to diagnose whether or not the patient has dementia with a focus on memory and understanding. Simplified Intellectual Function Examination Scale, DSM-3 (Roman numeral 3) -R, an international examination subject, National Seken Screening Test (Kuroshishi Murobushi: Medical and Nursing for Senile Dementia, Kongo It is possible to diagnose whether or not the subject has dementia, particularly Alzheimer-type dementia, by examination such as publication, mainly Chapter 1 pp15-38 (1990).

  Further, the dementia diagnosing device 1 connects the line-of-sight display device 3, the control means 11 and the diagnosis means 13 via a network (communication means) such as the Internet, an intranet, a LAN, etc. Is output to the diagnostic means 13 via the network, and it is possible to diagnose whether or not the subject in the remote place has Alzheimer's dementia.

(Configuration of line-of-sight display device)
The line-of-sight display device 3 displays (presents) a copied task figure that is a subject (task) to be copied by the subject, acquires a trace (traced) of the copied task figure as trajectory data (trace data), and The line-of-sight data indicating the movement of the line of sight is calculated from the movement of the eyeball of the subject at the time of copying (eye movement), and the locus data and the line-of-sight data are superimposed and displayed on the copying task figure. An assignment graphic data display means 7, a copying assignment graphic data recording means 9, and a line-of-sight copying locus display means 10 are provided.

  The line-of-sight detection means 5 captures the eyeball of the subject when copying (tracing) the copying task figure, and calculates line-of-sight data indicating the movement of the line of sight (information connecting gaze points in time series). A rotating mirror 5a, a rotating mirror driving unit 5b, an infrared camera 5c, an infrared LED 5d, and a line-of-sight data calculating unit 5e are provided. The line-of-sight data detected here is generated by a combination of the eye movement (direct eye movement) of the subject and the relative eye movement caused by the movement of the body or head.

  The rotating mirror 5a reflects the reflected light reflected by the white eye part (sclera) and the black eye part (cornea) of the subject's eyeball in accordance with the movement of the subject's head in the horizontal and vertical directions. Is incident on the infrared camera 5c. The rotating mirror 5a is a two-axis control mirror in the X and Y directions, and can reliably photograph the subject's eyeball even if the subject's head moves, and can detect the subject's line of sight (gaze data). .

  The rotating mirror driving means 5b is composed of a stepping motor or the like, and is activated based on an operation signal output from the control means 11, and controls the rotation angle of the rotating mirror 5a to continuously drive (rotate). )

  The infrared camera 5c (photographing means) is a photographing camera having infrared sensitivity, has an autofocus and zoom function, is activated based on the operation signal output from the control means 11, and is rotated by the rotating mirror 5a. The reflected subject's eyeball is photographed when the subject is replicating the copying task graphic. This infrared camera 5c captures the reflected light reflected by the eyeball of the subject from the infrared light emitted from the infrared LED 5d. The infrared camera 5c can always detect the movement of the eyeball of the subject with high accuracy by the autofocus and zoom functions.

  The infrared LED 5d (infrared light irradiating means) is for irradiating the white eye part (sclera) and the black eye part (cornea) of the eyeball of the subject with invisible infrared light. In this embodiment, since the movement of the eyeball is detected by a corneal reflection method (details will be described later), two infrared LEDs 5d are used to irradiate the corneal surface. Under bright external light or the like, a system in which many infrared LEDs 5d are arranged so as to surround the lens of the infrared camera 5c is also used. Incidentally, when detecting the movement of the eyeball by the scleral reflection method, two infrared LEDs 5d detect the movement (movement) of the eyeball in the horizontal direction and detect the movement (movement) of the eyeball in the vertical direction. In order to do this, a total of four are required.

  A configuration example (arrangement example) of these rotary mirror 5a, rotary mirror drive means 5b, infrared camera 5c, and infrared LED 5d is shown in FIG. As shown in FIG. 2, infrared LEDs 5d are arranged on both sides of the infrared camera 5c, a rotating mirror 5a is arranged on the photographing lens side of the infrared camera 5c, and the rotating mirror is driven in the depth direction of the rotating mirror 5a. Means 5b (only the rotating shaft is shown in FIG. 2) is arranged. The rotating mirror 5a is driven by the rotating mirror driving means 5b so as to always face the subject's eyeball (so that reflected light enters from the eyeball).

  Here, how the line-of-sight detection means 5 detects the movement of the eyeball of the subject (corneal reflection method) will be described with reference to FIGS. FIG. 6 shows an example of an image of an eyeball portion photographed according to the corneal reflection method. FIG. 7 is a diagram illustrating the detection principle of the corneal reflection method.

  In the corneal reflection method, first, infrared light (infrared rays) is irradiated on the eyeball portion of the subject, and the eyeball portion of the subject is photographed. As shown in FIG. 6, the infrared light (infrared light) irradiated to the eyeball portion of the subject is reflected from the retina of the eyeball, and again from the pupil portion (black eye portion) that is narrowed down by the iris (eye stop). The light is emitted and photographed as a bright white “circle” (in FIG. 6A) by the infrared camera 5c (see FIG. 1). On the other hand, the infrared light (infrared light) irradiated on the subject's eyeball surface is reflected from the surface of the black eye part (cornea) and photographed as a bright light spot (reflected light spot (representative point), FIG. 6B). Is done.

  Further, as shown in FIG. 7, since the rotation center of the eyeball (“O” in FIG. 7) and the rotation center of the cornea (“O ′” in FIG. 7) are different, The position of the center of the white “circle” shown in FIG. 6A, that is, the center of the pupil, and the reflected light spot reflected by the cornea shown in FIG. This shift is detected as an eyeball momentum in the corneal reflection method.

  With respect to the movement of the head of the body, the center of the white “circle” shown in FIG. 6A, that is, the center of the pupil and the cornea shown in FIG. The position of the reflected light spot that is reflected is simultaneously shifted in the same direction by the same amount. In other words, by using the corneal reflection method, the amount of movement by eye movement of the subject (eye movement amount, direct eye movement) and the amount of movement caused by movement of the subject's body or head (relative eye movement) And can be detected separately. For this reason, the rotating mirror 5a can always be made to oppose the said test subject's eyeball according to a motion of a test subject's eyeball.

Returning to FIG. 1, the description of the line-of-sight display device 3 of the dementia diagnosis device 1 will be continued.
The line-of-sight data calculating means 5e captures the reflected light reflected by the eyeball of the subject with the infrared camera 5c, and the eyeball of the subject moves in the horizontal direction and the vertical direction due to the difference in the amount of reflected light of the captured reflected light. The eye movement data (eye movement) is calculated from time-series information in which the eye movement (eye movement) is temporally continuous.

  The replication task graphic data display means 7 displays the replication task graphic and acquires a trajectory copied by the subject as trajectory data, and includes a display means 7a and a trajectory data acquisition means 7b.

  The display unit 7a displays the copied task graphic based on the copied task graphic data recorded in the copied task graphic data recording unit 9, and the trajectory data acquired by the trajectory data acquiring unit 7b is displayed in the copied task graphic. It is displayed in a superimposed manner.

  The trajectory data acquisition means 7b acquires the trajectory copied by the subject as trajectory data for the simulated task graphic displayed on the display means 7a. In this embodiment, the trajectory data acquisition means 7b is constituted by a pressure sensor that detects the pen pressure used when the subject replicates. Further, for example, the trajectory data acquisition means 7b includes a writing instrument in which a transmitter that transmits ultrasonic waves is embedded, and an ultrasonic detector that detects a trajectory drawn by the writing tool from the intensity of the ultrasonic waves transmitted from the transmitter ( (Not shown).

  In this embodiment, the copy assignment graphic data display means 7 is configured as a touch panel type liquid crystal screen as shown in FIG. The copying task graphic data display means 7 is provided integrally with the line-of-sight detection means 5, and the casing of the infrared camera 5 c of the line-of-sight detection means 5 surrounds the display surface of the copying task graphic data display means 7. The upper end of the body is fitted almost in the center. In this touch panel type liquid crystal screen, the display means 7a is configured as a liquid crystal screen, and the trajectory data acquisition means 7b is configured as a touch panel attached to the display surface of the liquid crystal screen. In FIG. 3, a hollow cross is displayed on the display surface of the display unit 7 a (see FIG. 1) of the copy task graphic data display unit 7 as an example of the copy task graphic.

  When the copy task graphic data display means 7 is composed of a touch panel type liquid crystal screen, the subject can copy the copy task graphic displayed on the liquid crystal screen with the stylus pen or his / her finger within the touch panel, or trace it. The trajectory data (tracing data) can be displayed on the liquid crystal screen at the same time.

  In addition, as shown in FIG. 4, the copying task graphic data display means 7 includes two infrared cameras 5c of the line-of-sight detection means 5, that is, an infrared camera 5c (L) and an infrared camera 5c (R). The subject's eyeball may be photographed by the two infrared cameras 5c (L) and 5c (R). The necessity of providing the two infrared cameras 5c (L) and 5c (R) is that when the subject views the vicinity, the photographing field angle of the eyeball viewed from the camera exceeds 30 degrees, and one infrared camera is provided. This is because in the camera 5c, it may be difficult to capture an eyeball image when the left and right ends of the display are watched.

  The detection area in which these infrared cameras 5c (L) and 5c (R) detect the eyeball of the subject is the border of the subject on the display surface of the display means 7a of the copying subject graphic data display means 7 as a boundary. It is divided into a left visual field detection area (5c (L) charge detection area) for detecting the left eye movement and a right visual detection area (5c (R) charge detection area) for detecting the right eye movement of the subject. It has been. In order to calculate the line-of-sight data from the eye movements of the subject, it is sufficient if there is an eyeball image of at least one of the infrared camera 5c (L) or the infrared camera 5c (R). When copying (tracing), an infrared camera 5c that detects the eyeball of the subject when it is determined that the line of sight (line-of-sight data) has crossed the hatched area shown in FIG. Switching between (L) and the infrared camera 5c (R) is performed.

  That is, when the eye movement of the right visual field of the subject is detected by the infrared camera 5c (R), the line-of-sight data calculated from the eye movement of the right visual field is detected in charge of the left visual field detection area (5c (L)). When it enters the area), the eye movement of the subject's left visual field is detected by the infrared camera 5c (L).

  The attachment positions of the infrared cameras 5c (L) and 5c (R) may be on the back surface of the display means 7a of the copying subject graphic data display means 7, and the infrared cameras 5c (L) and 5c (R). Each of the photographic lenses may be provided at substantially the center of the left edge and the center of the right edge of the casing surrounding the display surface of the display means 7a.

  Further, as shown in FIG. 5, the copying task graphic data display means 7 includes a display means 7a and a transparent transparent touch panel (trajectory data acquisition means) 7b, and an infrared camera 5c of the line-of-sight detection means 5; The infrared LED 5d and the half mirror 5f may be integrated.

  As shown in FIG. 5, the light (image) emitted (emitted) from the display means 7a of the copy task graphic data display means 7 is subjected to visible light reflection coating treatment and infrared light transmission on the display surface side of the half mirror 5f. By performing the coating process, the light is reflected through the reflection surface of the half mirror 5f, projected onto the screen surface of the transparent touch panel (trajectory data acquisition means) 7b, and displayed. Moreover, since the half mirror 5f transmits infrared light by the infrared light transmission coating process, the infrared camera 5c and the infrared LED 5d of the line-of-sight detection means 5 are installed on the back side of the half mirror 5f. The infrared light reflected by the face part (near the eyeball) of the subject facing the transparent touch panel (trajectory data acquisition means) 7b is photographed by the infrared camera 5c.

Returning to FIG. 1, the description of the line-of-sight display device 3 of the dementia diagnosis device 1 will be continued.
The copying task graphic data recording means 9 is constituted by a hard disk, a memory or the like, and records copying task graphic data which is data for drawing the copying task graphic on the display means 7a of the copying task graphic data display means 7. Is.
This simulated task graphic data includes, for example, geometric figures (patterns) such as hollow crosses, triangles, and cubes, and simple natural images such as flowers and mountains.

  The line-of-sight replication trajectory display means 10 superimposes and displays the trajectory data and the line-of-sight data on the replication task graphic drawn based on the replication task graphic data recorded in the replication task graphic data recording means 9.

  According to this line-of-sight display device 3, the copying task graphic data display means 7 displays the copying task graphic based on the copying task graphic data recorded in the copying task graphic data recording unit 9. The trajectory copied by the subject while viewing is acquired as trajectory data by the trajectory data acquisition means 7b. Then, at the same time that the subject obtains the trajectory data copied, the eyeball when the subject copies the copy task graphic while looking at the copy task graphic is photographed by the infrared camera 5c. Based on the photographed eyeball image, the line-of-sight data calculating means 5e calculates line-of-sight data indicating the movement of the line of sight of the subject.

  Here, since the trajectory data acquisition means 7b and the infrared camera 5c are arranged on the display surface side of the copying task graphic data display means 7 and are provided integrally, the subject wears goggles as in the past. The subject can be copied while watching the copy task figure without being restricted in posture, and at the same time, the eyeball movement when copying with the infrared camera 5c is photographed. can do. In the present invention, the eye-gaze detection means 5 is not used, and the subject can wear goggles as in the past, and eye movement can be detected and used as eye-gaze data.

  In addition, according to the line-of-sight display device 3, the photographing lens of the infrared camera 5c (L) is provided at approximately the center of the left side edge of the casing surrounding the display surface of the display means 7a of the copying subject graphic data display means 7. The imaging lens of the infrared camera 5c (R) is provided almost at the center of the right edge of the housing, and the distance between the subject and the display surface is obtained by photographing the eyeball while gazing at the left and right fields of view. Regardless of the detection angle), a good eyeball image can be taken even for the eyeball movement of the eyeball moving in a wide range on the left and right.

  Further, according to the line-of-sight display device 3, the copy task graphic displayed on the display unit 7a of the copy task graphic data display unit 7 is displayed on the half mirror 5f by the visible light reflection coating process performed on the display surface side of the half mirror 5f. And is displayed on the screen surface of the transparent touch panel (trajectory data acquisition means) 7b and the half mirror 5f transmits infrared light by the infrared light transmission coating process. The infrared light irradiated by the infrared LED 5d is reflected on the face (eyeball) of the subject to be examined, and the reflected infrared light is transmitted and photographed by the infrared camera 5c provided on the back surface of the half mirror 5f. For this reason, when the subject copies (traces) the copy task graphic, he / she gazes at the transparent touch panel (trajectory data acquisition means) 7b on which the copy task graphic is projected, and the test subject can view his / her body and head. Even with slight movement, the subject's eyeball can be reliably photographed.

(Configuration of dementia diagnosis device including line-of-sight display device)
The description of the configuration other than the line-of-sight display device 3 of the dementia diagnosing device 1 shown in FIG. 1 is continued.
The control means 11 uses various operation signals (illustrated by dotted lines in FIG. 1) input by an operator of the dementia diagnosis apparatus 1 using an input means (not shown) such as a keyboard and a mouse as control signals. It outputs to a means and manages control of the said dementia diagnosing device 1. FIG.

  The operation signal is recorded in the rotating mirror driving signal for driving the rotating mirror driving means 5a of the line-of-sight detecting means 5, the camera starting signal for starting the infrared camera 5c and the infrared LED 5d, and the copying subject graphic data recording means 9. There is a copy assignment graphic data output signal for outputting the displayed copy assignment graphic data to the display means 7a.

  Further, in this operation signal, a reference line-of-sight pattern output signal for outputting the reference line-of-sight pattern recorded in the reference line-of-sight pattern recording means 15 to the diagnosis means 13 and a reference locus pattern recorded in the reference locus pattern recording means 17 are included. A reference trajectory pattern output signal to be output to the diagnosis unit 13, a reference trace pattern output signal to be output to the diagnosis unit 13 and a reference trace pattern recorded in the reference trace pattern recording unit 19 are recorded in the intelligent function test data recording unit 21. There is an intelligent function test data output signal that causes the diagnostic means 13 to output the intelligent function test data.

  Further, the control means 11 displays the intelligent function test data output from the intelligent function test data recording means 21 on the display means 7a of the copying task graphic data display means 7, and the subject inputs the input means (not shown). ) Is input to the diagnostic means 13. Further, the line-of-sight data obtained from the line-of-sight detection means 5 and the locus data obtained from the locus data acquisition means 7b are superimposed on the copying subject graphic data and output to the line-of-sight copying locus display means 10. 11 to 16 show examples of output display.

  The diagnosing unit 13 includes gaze data, trajectory data (tracing data) and simulated task graphic data, which are output results of the gaze display device 3, a reference gaze pattern recorded in the reference gaze pattern recording unit 15, and a reference trajectory pattern recording unit. 17, the reference trace pattern recorded in the reference trace pattern recording means 19, the intelligent function test data recorded in the intelligent function test data recording means 21, and input means (not shown). ) Based on the answer data input from the above, whether or not the subject has Alzheimer-type dementia is diagnosed.

  As shown in FIG. 8, the diagnosis unit 13 includes a reference line-of-sight pattern / line-of-sight data similarity calculation unit 13a, a trajectory data / line-of-sight data similarity calculation unit 13b, a copying task graphic data / line-of-sight data similarity calculation unit 13c, Line-of-sight data / numerical parameter similarity calculating means 13d, locus data / numerical parameter similarity calculating means 13e, copying task graphic data / numerical parameter similarity calculating means 13f, progress diagnosis means 13g, and collating means 13i It has.

  The reference line-of-sight pattern / line-of-sight data similarity calculation means 13a uses the similarity between the reference line-of-sight pattern recorded in the reference line-of-sight pattern recording means 15 and the line-of-sight data calculated by the line-of-sight data calculation means 5e for pattern recognition. Obtained (see Kenichiro Ishii et al., Pattern Recognition, Ohmsha (1998)) and is obtained by a pattern matching technique such as nearest neighbor decision rule, Bayes decision rule, and the matching result is output to the matching means 13i.

  The trajectory data / line-of-sight data similarity calculation means 13b records the trajectory data (tracing data) acquired by the trajectory data acquisition means 7b, the line-of-sight data calculated by the line-of-sight data calculation means 5e, and the reference line-of-sight pattern recording means 15. The similarity between the reference line-of-sight pattern recorded, the reference locus pattern recorded in the reference locus pattern recording means 17 and the reference trace pattern recorded in the reference trace pattern recording means 19 is determined based on the nearest neighbor determination rule, Bayes It is obtained by a pattern matching technique such as a decision rule, and the matching result is output to the matching means 13i.

  The copying task graphic data / line-of-sight data similarity calculating means 13c includes the copying task graphic data recorded in the copying task graphic data recording means 9, the line-of-sight data calculated by the line-of-sight data calculating means 5e, and the reference line-of-sight pattern recording means. 15 is obtained by a pattern matching technique such as nearest neighbor decision rule or Bayes decision rule, and the matching result is output to the matching means 13i.

  The line-of-sight data / numerical parameter similarity calculation means 13d includes the line-of-sight data calculated by the line-of-sight data calculation means 5e, and the numerical parameter that is a threshold for diagnosing Alzheimer-type dementia that is set in advance by a clinical test for the line-of-sight data Is obtained by a pattern matching technique such as a nearest neighbor decision rule or a Bayes decision rule, and the matching result is output to the matching means 13i.

  The trajectory data / numerical parameter similarity calculating means 13e includes the trajectory data (tracing data) acquired by the trajectory data acquiring means 7b, and Alzheimer-type dementia that has been set in advance by a clinical examination regarding the trajectory data (tracing data). The degree of similarity with a numerical parameter serving as a threshold value to be diagnosed is obtained by a pattern matching technique such as a nearest neighbor decision rule or a Bayes decision rule, and the matching result is output to the matching means 13i.

  The copied task graphic data / numerical parameter similarity calculating means 13f is a copy of the copied task graphic data recorded in the copied task graphic data recording means 9, and Alzheimer type dementia preset by clinical examination regarding the copied task graphic data. The similarity with a numerical parameter serving as a threshold for diagnosing the disease is obtained by a pattern matching technique such as a nearest neighbor decision rule or a Bayes decision rule, and the matching result is output to the matching means 13i.

  The progress diagnosis means 13g collates the intelligent function test data recorded in the intelligent function test data recording means 21 with the answer data obtained by the subject as the answer to the intelligent function test data by the matching judgment means 13h. Based on the verification result, the progress of cerebrovascular dementia or Alzheimer type dementia is converted into data (dementia progress data, for example, 10 levels of progress 1 to 10), and output to the verification means 13i It is.

  The matching unit 13i matches the matching result of the reference line-of-sight pattern / line-of-sight data similarity calculating unit 13a, the matching result of the locus data / line-of-sight data similarity calculating unit 13b, and the matching of the copying task graphic data / line-of-sight data similarity calculating unit 13c. A matching result of the line-of-sight data / numerical parameter similarity calculating means 13d, a matching result of the trajectory data / numerical parameter similarity calculating means 13e, a matching result of the copying task graphic data / numerical parameter similarity calculating means 13f, Based on the dementia progression degree data of the progression degree diagnosis means 13g, comprehensive determination is made and output as diagnosis result data.

  The total similarity varies depending on which item is prioritized and diagnosed as Alzheimer-type dementia based on an operation signal input by the operator. For example, the operator diagnoses whether or not the patient has Alzheimer-type dementia by referring only to the similarity between the trajectory data copied by the subject and the line-of-sight data based on an operation signal input by an input means (not shown). Then, when set, other similarities are diagnosed without being referred to, and are reflected in the diagnosis result data output from the collating means 13i. Further, as a comprehensive determination method, a method may be considered in which each calculation result is weighted based on data obtained clinically in advance and added to obtain a total score for determination.

Returning to FIG. 1, the description of the configuration of the dementia diagnosis device 1 other than the line-of-sight display device 3 will be continued.
The reference line-of-sight pattern recording means 15 is configured by a hard disk, a memory, or the like, and records a reference line-of-sight pattern that is specific line-of-sight data shown when the AD patient replicates the copy task graphic. In addition, the reference line-of-sight pattern recording unit 15 stores a subject of the target image tracking inspection and line-of-sight data of the AD patient. An example of the subject of the target image tracking inspection shown in FIG. 9 is shown. For reference, FIG. 9A shows an example of the line of sight of a healthy person, and FIG. 9B shows an example of the line of sight of an AD patient.

  The figure to be tracked in the target image tracking inspection shown in FIG. 9 is a rectangular wave-shaped geometric pattern, and the line of sight of the AD patient cannot follow the vertical line of the geometric pattern, It becomes almost a straight line.

Returning to FIG. 1, the description of the configuration of the dementia diagnosis device 1 other than the line-of-sight display device 3 will be continued.
The reference trajectory pattern recording means 17 is constituted by a hard disk, a memory, or the like, and records a reference trajectory pattern which is a specific trajectory pattern shown when the AD patient replicates the copying subject graphic.

  The reference trace pattern recording means 19 is configured by a hard disk, a memory, or the like, and records a reference trace pattern that is a specific trace pattern that is shown when an AD patient traces a copy task figure.

  The intelligent function test data recording means 21 is composed of a hard disk, a memory and the like, and includes graphics such as a clock and a writer, which are used for the memory ability test of the Hasegawa type simple intelligent function examination scale as an example. It records intelligent function test data.

  According to the dementia diagnosing device 1, the diagnosing unit 13 records the reference line-of-sight pattern recorded in the reference line-of-sight pattern recording unit 15 as a reference for the movement of the line of sight indicating symptoms of dementia, and the reference trajectory pattern recording unit. 17, at least one of the reference trace pattern recorded in the reference trace pattern recording means 19, the reference trace pattern recorded in the reference trace pattern recording means 19, the trace data output from the line-of-sight display device 3, and the copying task graphic data; Based on the matching result obtained by matching the line-of-sight data output from the display device 3, it is diagnosed whether or not the patient has dementia (Alzheimer-type dementia). That is, based on the output result of the line-of-sight display device 3, it can be diagnosed whether or not the patient has Alzheimer-type dementia.

  Further, according to the dementia diagnosing device 1, the visual line display device 3, the diagnostic means 13, the reference visual line pattern recording means 15, the reference trajectory pattern recording means 17, and the reference trace pattern recording means 19 are connected to a communication means such as a network. For example, if the line-of-sight display device 3 is at the subject, diagnosis can be made even if the subject is in a remote place.

(Operation of the dementia diagnosis device)
Next, the operation of the dementia diagnosis apparatus 1 will be described with reference to the flowchart shown in FIG. 10 (see FIG. 1 as appropriate).
First, the operator selects the copy task graphic data recorded in the copy task graphic data recording means 9 using an input means (not shown), and based on the copy task graphic data selected by the operator, The dementia diagnosing device 1 displays the copy task graphic on the display unit 7a of the copy task graphic data display unit 7 (S1).

  Subsequently, the infrared camera 5c of the line-of-sight detection means 5 and the infrared LED 5d enter a standby state according to the camera activation signal output from the control means 11 (S2). The rotating mirror 5a is also in a standby state. When the subject replicates (traces) the replication task graphic displayed on the display means 7a of the replication task graphic data display means 7, the dementia diagnosing device 1 causes the trajectory data (tracing) by the trajectory data acquisition means 7b. Data) is acquired (S3).

  The dementia diagnosing device 1 superimposes and displays the locus data of the replication obtained in (S3) on the replication task graphic displayed on the display means 7a of the replication task graphic data display means 7 (S4).

  Based on the rotating mirror drive signal, the subject's eyeball is being copied (traced) with the infrared camera 5c while following the rotating mirror 5a of the line-of-sight detecting means 5 based on the rotating task drive signal. S5).

  The dementia diagnosis apparatus 1 calculates line-of-sight data indicating the movement of the line of sight of the subject by the line-of-sight data calculation means 5e based on the detection principle of the corneal reflection method based on the eyeball image captured by the infrared camera 5c. And output to the diagnostic means 13 (S6).

  The dementia diagnosing device 1 causes the line-of-sight replication locus display means 10 to display the subject's replication locus (trajectory data) and line-of-sight data superimposed on the replication task graphic (S7). Here, the dementia diagnosing device 1 determines whether or not to execute the intelligent function test in accordance with the input operation signal (S8). The copying task figure, the copying locus (trajectory data), and the line-of-sight data displayed on the display means 7a of the display means 7 are once deleted from the display surface, and intelligent function test data is displayed (S9). Here, the subject inputs the answer data (S10).

  If it is not determined in S8 that the intelligent function test is to be executed, the dementia diagnosis apparatus 1 checks the diagnosis means 13 based on the operation signal input by the operator using the input means (not shown). The priority order of matching results to be prioritized by means 13i is determined, and diagnostic result data is generated (S11). Then, the dementia diagnosis device 1 displays the generated diagnosis result data on the line-of-sight replication locus display means 10 or outputs it to the outside (S12).

  As mentioned above, although embodiment of this invention was described, this invention is not limited to the said embodiment. For example, the processing of each component of the dementia diagnosis apparatus 1 can be regarded as a dementia diagnosis program described in a general-purpose computer language. If this dementia diagnosis program is installed in, for example, a server or the like connected to a network, and the visual line display device 3 is provided to the subject, the same effect as the dementia diagnosis device 1 can be obtained.

It is a block diagram of a dementia diagnosing device (including a visual line display device) that is an embodiment according to the embodiment. It is the figure explaining the structural example of the gaze detection means shown in FIG. It is the figure explaining the structural example (1 infrared camera) of the visual line display apparatus shown in FIG. It is the figure explaining the structural example (two infrared cameras) of the visual line display apparatus shown in FIG. It is the figure explaining the structural example (use of a half mirror) of the visual line display apparatus shown in FIG. (A) is the figure which showed the image | video of the cornea, (b) is the figure which showed the position output of the eyes | visual_axis. It is a figure explaining the detection principle of the cornea reflection system. It is a block diagram of the diagnostic means shown in FIG. It is the figure which showed an example of the target image tracking inspection problem. It is a flowchart explaining operation | movement of the dementia diagnosis apparatus shown in FIG. It is the figure which showed the example with scarce eye movement which reciprocates an original figure and a copying figure at the time of the conventional figure copying inspection. It is the figure which showed the example in which the reciprocating eye movement to which the position of the gaze point of an original figure and the gaze point of a copy figure did not respond | correspond at the time of the conventional figure reproduction inspection was seen. It is the figure which showed the example in which the small saccade concentrated locally and the deviation of the gaze point was seen from both figures at the time of the conventional figure reproduction inspection. It is the figure which showed the example in which the gaze point on the original figure was not seen at the time of the conventional figure reproduction inspection, and the closing in phenomenon was seen. It is the figure which showed the example which the gazing point increased when the original figure was traced at the time of the conventional figure reproduction inspection. It is the figure which showed an example of the original figure, a copying figure, and line-of-sight data at the time of the conventional figure copying inspection. It is the schematic which showed the goggles used at the time of the conventional figure reproduction inspection. (A) is the figure which showed the relationship between an eyeball, a photodiode, and infrared LED in a scleral reflection system, (b) is the relationship between an eyeball and a photodiode at the time of detecting a motion of a horizontal direction. (C) is a diagram showing the relationship between the eyeball and the photodiode when detecting the movement in the vertical direction.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Dementia diagnosis apparatus 3 Gaze display apparatus 5 Gaze detection means 5a Rotating mirror 5b Rotating mirror drive means 5c Infrared camera (imaging means)
5d infrared LED
5e Line-of-sight data calculation means 5f Half mirror 7 Copying task graphic data display means 7a Display means 7b Trajectory data acquisition means 9 Copying task graphic data recording means 10 Line-of-sight copying locus display means 11 Control means 13 Diagnosis means 15 Reference line-of-sight pattern recording means 17 Reference Trajectory pattern recording means 19 Reference tracing pattern recording means 21 Intelligent function test data recording means

Claims (7)

The replication task graphic to be copied is displayed to the viewer, and the trajectory data that is the trajectory of the replication task graphic copied by the viewer, and the viewer's copy when the replication task graphic is copied A line-of-sight display device that displays line-of-sight data, which is a movement of the line of sight obtained by measuring an eyeball, overlaid on the replication task graphic,
Copying task graphic data recording means for recording copying task graphic data which is data for drawing the copying task graphic;
Based on the copy task graphic data recorded in the copy task graphic data recording means, the copy task graphic data display means for displaying the copy task graphic,
Trajectory data acquisition means for acquiring trajectory data that is a trajectory that the viewer has copied the copying task graphic displayed on the copying task graphic data display means, and displaying the trajectory data on the copying task graphic data display means;
Eye movement measurement means for measuring the eye movement of the viewer when the trajectory data is acquired by the trajectory data acquisition means;
Line-of-sight data calculating means for calculating line-of-sight data indicating movement of the line of sight based on the measurement result measured by the eye movement measuring means;
A line-of-sight display device comprising: The eye movement measuring means is arranged on the display surface side of the copying task graphic data display means, and is a photographing means for photographing the eyeball of the viewer when acquiring the trajectory data.
2. The line-of-sight display device according to claim 1, wherein the line-of-sight data is calculated by the line-of-sight data calculation unit based on an eyeball image that is an image of the eyeball of the viewer photographed by the photographing unit. . Two of the photographing means are provided,
3. The line-of-sight display device according to claim 2, wherein photographing lenses of the photographing means are provided on both left and right edges of the casing surrounding the display surface of the copying task graphic data display means. The trajectory data acquisition means is configured as a transmissive touch panel,
A half mirror that has been subjected to a visible light reflection coating process and an infrared light transmission coating process on the display surface side of the copy task graphic data display means, and an infrared light irradiation means for irradiating infrared light;
The copy task graphic displayed on the copy graphic data display means is reflected on the reflection surface of the half mirror and displayed on the screen surface of the transmissive touch panel, and the photographing means and the infrared light irradiation means are displayed on the half mirror. The line-of-sight display device according to claim 2, wherein the line-of-sight display device is provided on a rear surface of the mirror.   The line-of-sight display device according to any one of claims 1 to 4, further comprising: a line-of-sight replication locus display unit that displays the locus data and the line-of-sight data superimposed on the replication task figure. The replication task graphic to be replicated is displayed to the viewer, the trajectory data that is the trajectory that the viewer replicates the replication task graphic, and the viewer's copy when the replication task graphic is replicated A dementia diagnosing device for diagnosing whether or not the viewer is dementia based on gaze data that is a gaze movement obtained by measuring an eyeball,
The line-of-sight display device according to any one of claims 1 to 5,
Reference line-of-sight pattern recording means for recording a reference line-of-sight pattern as a reference for movement of the line of sight indicating symptoms of dementia, associated with the copy task figure in advance,
At least one of the reference line-of-sight pattern recorded in the reference line-of-sight pattern recording means, the trajectory data, and the copy task graphic data that is data for drawing the copy task graphic, and the line-of-sight data output from the line-of-sight display device And a diagnostic means for diagnosing whether or not the viewer has dementia based on the result of the comparison operation,
A dementia diagnosing device comprising:   The dementia diagnosis apparatus according to claim 6, wherein the line-of-sight display device is connected to the reference line-of-sight pattern recording unit and the diagnosis unit via a communication unit.

Images