JP6402425B2 - Eye movement inspection device - Google Patents

Description

  The present invention relates to a technique for examining a relationship between eye movement and head movement of a target person in a captured image.

  In general, “vertigo” is a collective term for subjective symptoms that the sense of stability of the body has been lost, and vertigo is one of the most common symptoms that visit medical institutions.

  It can be roughly classified into central vertigo, peripheral vertigo, and psychogenic vertigo from the root cause of vertigo.

  Central vertigo is caused by abnormalities in the vestibular cortex, which is related to the vestibular function of the brainstem, cerebellum, and cerebral cortex, including the vestibular nucleus, cerebrovascular disorders, tumors, and degenerative diseases of the cerebellum and brainstem It is often caused by underlying diseases such as demyelinating diseases.

  On the other hand, peripheral dizziness is caused by the semicircular canal and the vestibule in the inner ear and the vestibular nerve that transmits these sensory information to the center.

  Here, the two otolith tools in the vestibule are sensory organs that control gravity and linear acceleration, and the semicircular canal senses the rotational movement of the head. The semicircular canal and the two otoliths are called vestibular sensory organs. The semicircular canal receptor is called cupra. When a cupra or otolith organ receptor is stimulated, an action potential is generated in the vestibular nerve, which is transmitted to the vestibular nucleus and the cerebellar apical nucleus via the auditory nerve.

  And in otolaryngology, neurology, etc., in the practice of dizziness and balance dysfunction, how the eyeball moves in response to eye stimulation, head stimulation, or ear stimulation Equilibrium function testing is widely conducted. Patent Document 1 discloses a balanced function test apparatus that uses an analysis method using vestibulo-oculomotor reflexes in such a balanced function test.

  This vestibulo-oculomotor reflex is a reflection in which the eyeball moves in the opposite direction to the rotation of the head, and when the acceleration stimulus in a certain direction continues, the eyeball is gradually displaced in the reverse direction and rapidly Repeat the regular movement to return to the original. For such exercise, for example, methods such as visual observation and video recording have been taken.

  In Patent Document 1, in the vestibulo-ocular reflex, among the repetitive eye movements, a portion where the eyeball position is gradually displaced is called a slow phase, and a portion where the eyeball position quickly returns to the original position is called a rapid phase. In Patent Document 1, vestibulooculomotor reflex is analyzed from nystagmus data obtained from captured images, and when used for diagnosis of dizziness, a portion of a rapid phase caused by the central action of the cerebellum and the like, and vestibulooculomotor reflex The nystagmus data is separated into the slow phase part caused by.

  On the other hand, conventionally, as a device for detecting a gaze direction, a gaze direction estimation device that detects a gaze direction from a face image (see, for example, Patent Document 2) or a spectacle-shaped device worn on the head is used. An apparatus that irradiates the eye with infrared light as parallel light and calculates the gaze direction based on the position of the pupil center and the position of the corneal reflected light from the captured image of the eye (see, for example, Patent Document 3) Various proposals have been made.

  In addition, a head-mounted information display device including a gaze area detection device that detects an area where the user is gazing from an eyeball image obtained by photographing the user's eyeball has been reported (for example, Patent Document 4). .

  In addition, in order to detect the human gaze direction with high accuracy, there is also a report on a method for measuring the position and orientation of a lens using electromagnetic induction between a coil attached to a contact lens and a coil installed around the head. There is (for example, Non-Patent Document 1).

  On the other hand, the person who is the subject of gaze estimation wears a contact lens on which a specific pattern using a retroreflective material is formed, and from the gaze direction estimation device side, toward the subject by a light source, There is also a proposal for a technique in which light of a predetermined wavelength is irradiated, imaging is performed by a camera, and a gaze direction is estimated and a person is identified by a reflected light pattern (for example, Patent Document 5). .

JP 2014-155534 A Japanese Patent No. 46952626 JP 2005-245791 A JP 2011-198141 A JP2013-158470A

Dale Roberts, Mark Shelhamer, and Aaron Wong, A new “wireless” search-coil system. Proceedings of the 2008 symposium on Eye tracking research applications ETRA 08 (2008) pp.197-198.

  However, in the technique described in Patent Document 1, a camera used for imaging can be made inexpensive, while an image capture timing (first timing) for capturing an image on a video input board and a galvano controller It is necessary to synchronize the start timing (second timing) for starting the presentation of the target or the change of the position. In addition, there is a problem that the data measured in this way is not necessarily presented as information that can be easily used as a criterion for judgment when differentiating between central and peripheral vertigo. .

  Furthermore, the conventional gaze detection technology focuses on detecting the subject's gaze, and in terms of eye movement and using this for examination for vertigo diagnosis, data measurement and data This is not the case.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to efficiently estimate eyeball movement and head movement of a target person from a captured image. It is an object of the present invention to provide an eye movement inspection apparatus capable of performing the above-described operation.

  Another object of the present invention is to present the correlation between eye movement and head movement estimated from a photographed image of a target person as information intended to be used as a reference for examination of vertigo. It is to provide a possible eye movement inspection device.

According to one aspect of the present invention, an eye movement inspection apparatus includes a contact lens that can be worn by a subject, and the contact lens includes a retroreflective material formed to form a predetermined reflection pattern, and the contact lens A light source for irradiating light, an imaging means for capturing an image including reflected light from a retroreflecting material, and a head for estimating the head movement of the subject for each axis in the world coordinate system Part movement estimation means, eye movement estimation means for estimating the eye movement of the subject in the head coordinate system for each axis of the head coordinate system, and eye movement and head movement And a correlation calculating means for calculating the correlation of the movements of the head movement and the eye movement for each axis, and the display means displays the correlation value .

  Preferably, the display means collectively displays the correlation value of the movement of each axis of the head movement and the eye movement calculated by the correlation calculation means on a display screen divided into an abnormal area and a normal area for each axis. And display.

  Preferably, the reflection pattern expresses a code for identifying whether it is the right eye or the left eye, and the eye movement estimation means estimates the eye movement for each of the right eye and the left eye using the code.

  Preferably, the head movement estimation unit estimates the head movement of the subject based on the image captured by the imaging unit.

  According to the present invention, it is possible to efficiently estimate the eyeball movement and the head movement of a target person from a captured image.

  Further, according to the present invention, the correlation between the eye movement estimated from the photographed image of the target person and the head movement can be presented as information intended to be used as a reference for examination of vertigo. Is possible.

It is a figure which shows the concept of a structure of the eye movement test | inspection apparatus 1000. FIG. It is a figure which shows the positional relationship of the test subject at the time of a test | inspection, and an imaging device (camera). It is a figure which shows the example of the pattern by a retroreflection material provided in the contact lens 10 with which the subject is mounted | worn. It is a functional block diagram which shows the function implement | achieved when CPU2040 runs software. It is a figure which shows the coordinate system expressing head movement and eyeball movement. 2 is a hardware block diagram of a computer system 20. FIG. It is a conceptual diagram for demonstrating rotation of a head and vestibulo-oculomotor reflection (horizontal direction). It is a conceptual diagram for demonstrating the mechanism of dizziness. It is a conceptual diagram for demonstrating one aspect | mode of operation | movement of the eye movement test | inspection apparatus 1000. FIG. It is a conceptual diagram for demonstrating another aspect of operation | movement of the eye movement test | inspection apparatus 1000. FIG. It is a conceptual diagram for demonstrating another one aspect | mode of operation | movement of the eye movement test | inspection apparatus 1000. FIG. It is a flowchart for demonstrating operation | movement when the eye movement test | inspection apparatus 1000 calculates and shows a correlation value. It is a figure which shows the example of a display of a correlation coefficient.

  Hereinafter, an “eye movement inspection apparatus” according to an embodiment of the present invention will be described. This eye movement inspection device is realized by software executed by a computer or a computer or other arithmetic device that operates according to a program, and a pattern of reflected light from a contact lens attached to a person's eye from a target image In addition, the human face, the posture and position of the face are detected based on the reflected light image, and the movement of the eyeball is estimated.

  Hereinafter, a configuration in which the eye movement inspection apparatus is realized by a general-purpose personal computer 100 will be described as an example.

  FIG. 1 is a diagram showing the concept of the configuration of the eye movement inspection apparatus 1000.

  FIG. 2 is a diagram showing a positional relationship between the subject at the time of the examination and the imaging device (camera).

  Referring to FIG. 1, a system 1000 that constitutes the eye movement inspection apparatus includes a CD-ROM (Compact Disc Read-Only Memory) or a DVD-ROM (Digital Versatile Disc Read-Only Memory) drive (hereinafter “optical disc”). A computer main body 2010 provided with a drive device for reading data from a recording medium such as 2030, a display 2120 as a display device connected to the computer main body 2010, and also connected to the computer main body 2010. It includes a keyboard 2100 and a mouse 2110 as input devices, a light source 28, and a camera 30 connected to the computer main body 2010 for capturing an image.

  The recording medium is not limited to an optical disk, and may be, for example, a non-volatile semiconductor memory such as a memory card. In that case, a memory drive 2020 (not shown) is provided.

  In the apparatus according to this embodiment, the camera 30 may be a monocular camera including a solid-state imaging device such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) sensor. However, the number of cameras may be one or a plurality. In the following description, it is assumed that an image is captured by a single monocular camera.

  As shown in FIG. 2, a person 2 (hereinafter referred to as “subject”) who is an object of eye movement and head movement estimation is wearing a contact lens 10. It is assumed that a specific pattern using a retroreflecting material is formed on the contact lens, as will be described later.

  In the eye movement inspection apparatus 1000, the light source 28 emits light of a predetermined wavelength toward the subject, and the camera 30 captures an image.

  Since the retroreflective layer returns strong reflected light in the illuminated direction, an optical pattern formed by a camera installed in the same direction as the illumination device can be stably measured. For example, by combining infrared illumination and an infrared camera, pattern measurement using the same principle is possible without causing discomfort to the lens wearer. By installing a known pattern on the lens, it is possible to detect movement such as rotation of the eyeball.

  The light from the light source 28 may be visible light, but may be light that is not visible to humans, such as infrared rays as described above. The camera 30 may be a camera using an image sensor for visible light or an image sensor for invisible light such as infrared light depending on the wavelength of light to be observed. These may be combined and imaged so that the light can be detected.

  FIG. 3 is a diagram illustrating an example of a pattern of a retroreflecting material provided on the contact lens 10 worn by the subject in FIG.

  FIG. 3A is a first example of a pattern provided on the contact lens 10.

  For example, a position where a pattern can be arranged on the contact lens 10 is defined in advance. In the example shown in FIG. 3A, such an arrangement possible position is set on a double concentric circle. Eight positions are set in the inner concentric circles, and eight positions are set in the outer concentric circles.

  Various reflection patterns can be realized by selectively arranging the retroreflecting material at such an arrangementable position. For example, a retroreflecting material is arranged every other out of 8 possible positions on the inner concentric circle, and the rotation angle from the center is out of the eight possible positions on the outer concentric circle. If every other retroreflecting material is arranged at the same position, one reflection pattern can be formed.

  The number of concentric circles is not limited to the above number, and the number of positions that can be arranged on the concentric circles is not limited to the above example.

  Furthermore, as long as the reflected light pattern is identifiable, the arrangement is not limited to a configuration in which the respective positions that can be arranged are arranged concentrically.

  FIG. 3B is a second example of a pattern provided on the contact lens 10.

  In the example shown in FIG. 3B, instead of arranging a uniform retroreflecting material at a predetermined position where the contact lens 10 can be arranged, for example, a two-dimensional reflection pattern arranged according to a predetermined rule is used. The area | region which has is provided. That is, when light is irradiated, a pattern is formed in which a portion where retroreflection occurs and a portion where it does not occur are two-dimensionally arranged in a predetermined region. Such a two-dimensional arrangement pattern can be different at each of the upper, lower, left and right positions of the contact lens.

  For example, although not particularly limited, a uniform retroreflective material is provided in a rectangular shape, and a diffuser is partially formed on the reflective surface side of the rectangular retroreflective material so as to form the two-dimensional reflective pattern. Furthermore, such a reflection pattern can be formed by arranging and masking. Or it is good also as a structure which provides a retroreflection material only in the part which should produce retroreflection among a two-dimensional reflection pattern, for example.

  Such a pattern is more desirable for detecting the rotational movement of the eyes.

  In this way, the reflection pattern formed by the retroreflecting material may express information that specifies whether the reflection is from the right eye or the left eye of the individual. If the right eye and the left eye can be identified in this way, it is possible to use such information on the position of the right eye and the left eye in estimating the position and posture of the head.

[System functional blocks]
As described below, the eye movement inspection apparatus 1000 according to the present embodiment estimates head position / posture and eye movement by detecting and tracking the reflection pattern described in FIG. 3 as face feature points. At the same time, the correlation between the two movements is calculated.

  FIG. 4 is a functional block diagram showing functions realized by executing a software by a central processing unit (CPU) 2040 described later in the eye movement inspection apparatus 1000 of the present embodiment. In FIG. 4, the contact lens 10 is not shown.

  Note that the functional blocks realized by the CPU 2040 among the functional blocks shown in FIG. 4 are not limited to processing by software, and some or all of them may be realized by hardware.

  Referring to FIG. 4, light source control unit 5600 controls the timing of turning on / off light source 28. Here, as described above, the light source 28 may be visible light, or infrared light may be used in consideration of an eye burden on the subject.

  The video signal corresponding to the moving image captured by the camera 30 is controlled by the image capture processing unit 5602 for each frame and captured as digital data. The image data recording processing unit 5604, for example, a nonvolatile storage device 2080 It is stored in a storage device.

  The retroreflective pattern detection unit 5606 searches the captured frame image sequence for the retroreflective pattern as described with reference to FIG. In general, retroreflection occurs in response to light irradiation from the light source 28. Therefore, in the camera 30, the intensity of light is detected strongly in an image region that receives such retroreflection. Alternatively, if the light from the light source 28 is composed of a component of a specific wavelength (or wavelength region), the camera 30 is used by using a camera 30 having a high sensitivity to such a wavelength, or the camera 30 is photographed. If it has a function that can be photographed by switching the wavelength (or wavelength region) of light, it is possible to detect the retroreflective pattern more selectively by switching such a photographing mode. is there. The position and arrangement information of the retroreflective pattern detected by the retroreflective pattern detection unit 5606 is stored in the storage device 2080 together with the time information.

  Based on the retroreflective pattern detected in this way, information that can distinguish between the right eye and the left eye based on information registered in advance in the nonvolatile storage device 2080 as corresponding to the pattern is recursive. When expressed by a reflection pattern, it is possible to specify from which eye the retroreflection pattern is reflected.

  Subsequently, at this time, although not particularly limited, the retroreflective pattern detection unit 5606 detects and tracks the facial feature points by detecting the positional relationship of the nose and mouth other than the eyes. At this time, if it is determined whether the eye is a left eye or a right eye, this information can also be used for extracting facial feature points.

  Subsequently, the head position / posture estimation unit 5610 performs imaging by processing similar to that in the gaze direction detection processing by a monocular camera as described in, for example, Patent Document 1 (Japanese Patent No. 46952626). A head position and head posture estimation process is performed on the image data from the camera.

  Note that the method for estimating the head position and orientation is not limited to such a method, and any other method may be used as long as it is a method for estimating from a captured image.

  The head position / posture of the specified specific person is stored in the nonvolatile storage device 2080 for use at the next processing timing as the head position / posture at the time.

  The eye movement estimation unit 5618 includes information on the position and arrangement of the retroreflective pattern extracted at the current time, information on the position and posture of the head extracted before the current time and stored in the storage device 2080, and Based on the position and orientation of the retroreflective pattern before the current time, according to the head position and posture estimated at each time, in a coordinate system based on the head (head coordinate system) Eye movement, for example, the magnitude, direction, and angular velocity of the eye movement are estimated. Information on the magnitude, direction, and angular velocity of the estimated eye movement velocity is stored in the storage device 2080.

  Information such as the head movement direction instructed to the subject 2 may be controlled by the task control unit 5613 and displayed on the task presenting unit 2130 by the output control unit 5616. The assignment presenting unit 2130 can use a display arranged at a position that falls within the visual field of the subject 2.

  Further, the output control unit 5616 performs a process for displaying the head movement information and the eye movement information estimated as described above on the display unit 2120 such as a display. At this time, information such as the direction of head movement instructed to the subject 2 is also displayed.

  Further, as will be described later, the correlation value calculation unit 5615 calculates the correlation value between the eye movement and the head movement in each direction of the x, y, and z axes, and displays each correlation value by the output control unit 5616. Part 2120 can be displayed.

  Based on the information displayed on the display 2120, the doctor can refer to information on the eye movement of the subject 2 as examination data for vertigo discrimination.

  FIG. 5 is a diagram showing a coordinate system expressing head movement and eye movement.

  In FIG. 5, the vertical direction (z direction), the horizontal direction (y direction), and the rotating direction (x direction) of the head in the world coordinate system calculated from the head position and posture at each time estimated in this way. ) Around the vertical velocity (z ′ direction) and horizontal direction (y ′ direction) of the eyeball in the head coordinate system calculated from the angular velocities φx, φy, and φz around And angular velocities ωx, ωy, ωz around the rotation direction (x ′ direction).

  By using the retroreflective pattern, it is possible to detect the rotational movement of the eyeball in the head coordinate system, and using this, it is possible to estimate which axis the eyeball movement is moving around. .

(Hardware configuration)
FIG. 6 is a hardware block diagram of the computer system 20.

  6, in addition to the memory drive 2020 and the disk drive 2030, the computer main body 2010 includes a CPU 2040, a bus 2050 connected to the disk drive 2030 and the memory drive 2020, and a ROM 2060 for storing programs such as a bootup program. And a RAM 2070 for temporarily storing instructions of the application program and providing a temporary storage space, and a non-volatile storage device (for example, a hard disk (HDD) for storing the application program, the system program, and data )) 2080, a communication interface 2090 for communicating with an external device such as a server via a network or the like, and an image input interface for receiving an image signal from the camera 30. And an interface 2092.

  A program that causes the computer system 20 to execute the function of the eye movement inspection apparatus according to the present embodiment is stored in the CD-ROM 2200 or the memory medium 2210, inserted into the disk drive 2030 or the memory drive 2020, and further stored in the hard disk 2080. May be forwarded. Alternatively, the program may be transmitted to the computer main body 2010 via a network (not shown) and stored in the hard disk 2080. The program is loaded into the RAM 2070 at the time of execution.

  The computer system 20 further includes a keyboard 2100 and a mouse 2110 as input devices, and a display 2120 as an output device.

  The program for functioning as the computer system 20 as described above does not necessarily include an operating system (OS) that causes the computer main body 2010 to execute functions such as an information processing apparatus. The program only needs to include an instruction portion that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 20 operates is well known and will not be described in detail.

  Further, the computer that executes the program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  Further, the CPU 2040 may be a single processor or a plurality of processors. That is, it may be a single core processor or a multi-core processor.

  FIG. 7 is a conceptual diagram for explaining the rotation of the head and the vestibular movement reflection (horizontal direction).

  When the head rotates to the left, at the start of rotation, the lymph in the semicircular canal flows in the opposite direction due to inertia. In the left outer semicircular canal, sensory hair falls to the moving side and an excitatory response occurs. This excites the left vestibular nucleus neuron. This is the vestibulo-oculomotor reflex due to the peripheral system.

  FIG. 8 is a conceptual diagram for explaining the mechanism of dizziness.

  As described above, the semicircular canal is an angular velocity sensor of the human body, and there are three semicircular canals (front semicircular canal, latter half canal, horizontal semicircular canal) corresponding to the three rotation axes.

  When angular acceleration is applied to each semicircular canal, endolymph flow occurs, cupra is displaced, sensory cells are stimulated, and the vestibular nerve nucleus causes vestibulo-oculomotor reflexes, so that the semicircular canal is nystagmus in a plane parallel to the semicircular canal. Cause (compensatory movement).

  At this time, if normal compensation movement does not occur, dizziness occurs.

  Among peripheral vertigo, those caused by the semicircular canal have an abnormality in one of the three semicircular canals.

  On the other hand, in central vertigo, all axes fail.

  Therefore, if it is known whether the axis where the disorder occurs is a part or all, it can be used to distinguish between central vertigo and peripheral vertigo.

  FIG. 9 is a conceptual diagram for explaining an aspect of the operation of the eye movement inspection apparatus 1000.

  In FIG. 9, only the main ones of the functional blocks shown in FIG. 4 are extracted and shown for ease of explanation.

  In the example of FIG. 9, an instruction about the direction of head movement is given directly orally by the doctor to the subject.

  From the captured image of the subject wearing the contact lens 10 moving his / her head, the head position / posture estimation unit 5610 estimates the head movement, and the eye movement estimation unit 5614 estimates the eye movement.

  The display unit 2120 outputs to the display unit 2120, for example, displays indicating temporal changes in head movement and eyeball movement in three axis directions, respectively.

  Accordingly, the doctor can grasp the dizziness situation.

  FIG. 10 is a conceptual diagram for explaining another aspect of the operation of the eye movement inspection apparatus 1000.

  The difference from FIG. 9 is that the instruction of the head movement direction to the measurement subject is performed by display via the task presentation unit 2130 and the movement direction of the head presented to the measurement subject is displayed. It is displayed on the part 2120.

  FIG. 11 is a conceptual diagram for explaining still another aspect of the operation of the eye movement inspection apparatus 1000.

  The difference from FIG. 9 is that the instruction of the head movement direction to the measurement subject is performed by display via the task presentation unit 2130 and the correlation between the head movement and the eyeball movement by the correlation value calculation unit 5615. A value is calculated for each rotation about the direction of the three axes, and the head movement direction presented to the measurement subject and such a correlation value are displayed on the display unit 2120. Note that the direction of head movement direction to the measurement subject may be directly instructed verbally by a doctor or the like.

  As will be described later, by displaying the correlation values for the three axes, information that can be used more intuitively to distinguish between central vertigo and peripheral vertigo is displayed.

  FIG. 12 is a flowchart for explaining an operation when the eye movement inspection apparatus 1000 shown in FIG. 4 calculates and presents a correlation value as shown in FIG.

  Referring to FIG. 12, when the processing is disclosed, first, an instruction of the head movement direction is displayed on task presentation unit 2130 under the control of task control unit 5613 (S100).

  Subsequently, the retroreflection pattern detection unit 5606 measures the retroreflection pattern (S102), and the head position / posture estimation unit 5610 estimates the head position and posture (S104).

  Here, as shown in FIG. 5, the vertical direction (z direction), the horizontal direction (y direction), and the rotating direction (x direction) of the head in the world coordinate system calculated from the head position and posture at each time ) Are estimated, and the estimation results are stored in the storage device 2080 (S106).

  Further, the eye movement estimation unit 5614 calculates the vertical direction (z ′ direction), horizontal direction (y ′ direction), and rotation direction of the eyeball in the head coordinate system calculated from the retroreflective pattern detected at each time. Angular velocities ωx, ωy, ωz around (x ′ direction) are estimated and stored in the storage device 2080 (S108).

  Furthermore, the head position / posture estimation unit 5610 calculates a head movement integrated value represented by the following equation.

Here, i is a variable representing the current time. For example, if the time step of processing is Δt, the current time t = i × Δt. If a _x , a _y , and a _z each exceed a certain value, the measurement of that axis is considered complete (S110), and the process proceeds to step S112. Until a _x , a _y , and a _z each exceed a certain value, the processing of steps S102 to S108 is repeated for the corresponding axis.

  Here, if the measurement is not completed within a certain time, it may be determined that the measurement has failed.

In step S112, a head movement-eye movement correlation coefficient (s _x , s _y , s _z ) is calculated by the following calculation formula.

Thereafter, the correlation coefficient value is displayed on the display unit 2120.

  FIG. 13 is a diagram showing a display example of the correlation coefficient obtained as a result of the processing of FIG.

  As shown in FIG. 13, for each of the vertical direction, the horizontal direction, and the rotation direction, the correlation coefficient between the head movement and the eye movement of each of the three axes is regarded as a score divided into a plurality of ranks.

  For example, when the correlation coefficient is close to −1, the most normal (lightest gray) is displayed, and when the correlation coefficient is 0, the most abnormal (darkest gray) is displayed in stages. At this time, the mark at the corresponding stage is turned on. Note that the display may be divided by color.

  Then, the abnormal region for each axis is displayed inside the circle and the normal region is displayed outside the circle, and if there is a measurement result inside this circle, it is assumed that it is an abnormal value. With such a display, it is possible to determine whether there is an abnormality for each axis.

  Therefore, for example, if all three axes are in the abnormal range, it is possible to determine that the possibility of central vertigo is high, and if only some of the axes are in the abnormal range, it is possible to determine that there is a high possibility of peripheral vertigo.

  As described above, the eye movement inspection apparatus 100 forms a plurality of optical patterns that can be measured from the outside by the retroreflective layer provided on the contact lens, and remotely measures the position of the pattern by the camera. The position / posture of the lens is specified from the position of the pattern, and the eye movement of the subject photographed by the camera is continuously measured, and the position / posture of the head is also continuously measured.

  Then, the correlation between the head position and posture measured in this way and the eye movement is calculated and displayed for each axis, thereby presenting data for discriminating between peripheral vertigo or central vertigo. It becomes possible.

  Further, since the lens posture is directly measured, there is an advantage that it is not necessary to perform calibration every time and is convenient.

  In the above description, the movement of the head has been described as being estimated based on the captured image. However, for example, by attaching a gyro sensor or the like to the head, it may be configured to detect the movement of the head with a signal received from the gyro sensor.

  Embodiment disclosed this time is an illustration of the structure for implementing this invention concretely, Comprising: The technical scope of this invention is not restrict | limited. The technical scope of the present invention is shown not by the description of the embodiment but by the scope of the claims, and includes modifications within the wording and equivalent meanings of the scope of the claims. Is intended.

  10 contact lens, 28 light source, 30 camera, 2010 computer main body, 2020 optical disk drive, 2030 optical disk drive, 2040 CPU, 2050 bus, 2060 ROM, 2070 RAM, 2080 hard disk, 2100 keyboard, 2110 mouse, 2120 display unit, 2130 Task presentation unit, 2210 Memory card, 5600 Light source control unit, 5602 Image capture processing unit, 5604 Image data recording processing unit, 5606 Retroreflective pattern detection unit, 5610 Head position / posture estimation unit, 5613 Task control unit, 5614 Eye movement An estimation unit, 5615, a correlation value calculation unit, and a 5616 output control unit.

Claims (4)

It has a contact lens that can be worn by the subject,
The contact lens includes a retroreflecting material formed so as to form a predetermined reflection pattern,
A light source for irradiating the contact lens with light;
Imaging means for capturing an image including reflected light from the retroreflecting material;
Head movement estimating means for estimating the head movement of the subject for each axis in the world coordinate system;
Eye movement estimation means for estimating the eye movement of the subject in the head coordinate system for each axis of the head coordinate system based on the image captured by the imaging means;
Display means for displaying the eye movement and the head movement in association with each other;
Correlation calculating means for calculating a correlation of movement for each axis between the head movement and the eye movement;
The display means is an eye movement inspection device that displays the correlation value . The display means displays the correlation value of the movement of each of the head movement and the eye movement calculated by the correlation calculation means on a display screen divided into an abnormal area and a normal area for each axis. The eye movement inspection device according to claim 1 , wherein the eye movement inspection device is displayed collectively. The reflection pattern represents a code for identifying whether it is a right eye or a left eye,
The eye movement estimating means, by using the code for each right and left eye, estimates the eye movement, eye movement testing device of claim 1 or 2. Said head motion estimation means, based on the image captured by the imaging means, for estimating the head movement before Symbol subject, the eye movement testing device according to any one of claims 1-3.