JPS63160633A - Eyeball motion detector - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to an eye movement detection device, and particularly to an eye movement detection device that can accurately detect the movement of W1'R without causing pain to a subject.

[Conventional technology]

Eye movement detection devices are widely used in fields ranging from medicine, psychology, education, sports to industrial fields because it is possible to learn about a person's psychology and state of mind by observing the movement of a person's eyeballs. ing.

Conventional devices that detect eyeball movements can be roughly divided into "eye mark recorders" that utilize the movement of eye marks.

A device that uses changes in the amount of light reflected by the cornea.

E, O, G, (electro oculography) that uses the potential difference in the skin around the eyeballs.

Three types are known, but the eye mark recorder is currently considered the most suitable for accurately detecting eye movements without causing pain to the subject.

The eye mark recorder includes means for forming an image of the eye mark on the eyeball, an imaging section, and a third register that stores the image signal of the eye mark converted by the imaging section.

an extraction means for extracting the coordinate point of the eye mark based on the image signal trap stored in the register of p43; - F of the eye mark! The apparatus includes calculation means for calculating the rotation angle and rotation direction of the eye mark based on the point Am.

Next, a conventional eye movement detection device will be described in detail with reference to the drawings.

FIG. 6 is a diagram showing a conventional example.

The eye movement detection device shown in FIG. ! ! fi
Extract the coordinate points of the eye mark based on the image signal stored in the third register 3C, which is stored in ts 2, the third register 3C that stores the image signal of the eye mark converted in the 3a subsection 2, and the third register 3C in F\tI. and a calculating means 11 that calculates the rotation angle and rotational force direction of the eye mark based on the coordinate points of the eye mark.

Here, when the eye mark g is imaged on the eyeball by the incident light f from the means 9 for forming an image on the eyeball, the light reflected from the eyeball is reflected as if the eyemark g was a light source. , and enters the imaging section 2 through the Kuyatsuta 1. Next, after converting the reflected light into an eye mark image signal i in the imaging section 2, it is recorded in the third register 3C as 1. Make cypress.

Next, after extracting the coordinate point j of the eye mark g by the extracting means 10 which extracts the coordinate point of the eye mark g based on the image signal i of the eye mark g stored in the third register 3C, the extracted eye mark As means 11 for calculating the rotation angle and rotation direction of the eye mark g based on the coordinate point jVc of the eye mark g, the coordinate point j of the eye mark g and the rotation angle θ! The rotation direction βl is calculated from the equation (2) using the equation (1) which is established based on the geometrical relationship between the two.

01 'sin'(J'5Eanimals-ys"/m)...
...(1) 711 = 5in-' (Xs/anti-fan 7) ""...(2) Problems to be solved by the invention] The above-mentioned conventional eyeball movement detection device has an eyeball rotation angle θ. Instead, the rotation angle θ1 of the eye mark g is calculated, and there is only a geometric proportional relationship of up to about 15 degrees between the two. In general, the maximum eyeball rotation angle for humans is 3
Since the conventional detection device can rotate up to 30 degrees upward and about 75 degrees downward, the detection range of the conventional detection device is extremely narrow.

Furthermore, since the dimensions of the eyeball differ depending on age, sex, age, etc., when formula (1) is used, the distance m from the center of eyeball rotation to the center of corneal curvature is This has the disadvantage that it must be predetermined by other methods.

In addition, the distance m from the center of rotation of the eyeball to the center of corneal curvature cannot be directly measured like the size of a stoma, but is calculated indirectly using a woodcutter's device, so the error is large. ,
Therefore, in equation (1) using this value, an error occurs between the eye mark g and the actual rotation angle θ1, and the eye mark g
Even within the proportional range of the rotation angle θ1 of the eyeball and the rotation angle θ of the eyeball, there is a drawback that an error occurs between the value of equation (1) and the rotation angle θ of the eyeball.

[Means for solving problems]

The eye movement composition device of the present invention includes: / Yatta and the imaging department.

a first register that stores an image signal converted by the imaging unit;

Extracting means for extracting contour data based on the image signal stored in the first register.

and a first protrusion means for calculating center coordinates of the contour based on the contour data.

a second step of calculating the area within the contour based on the contour data;
and the means of calculation.

a switch for selecting an area to be stored in the register from among the areas calculated by the second calculating means;

a second register for storing the contour area selected by the switch;

It is configured to include a third calculation means for calculating the rotation angle and rotation direction of the eyeball based on the contour area stored in the second register and the contour area not stored in the second register.

〔Example〕

Next, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing one embodiment of the present invention.

The eye movement detection device shown in Figure 1 is Nyatta] and Gekizobu 2.

and a first register 3a for storing the image signal converted by the transport section 2.

extraction means 4 for extracting contour data based on the image signal stored in the first register 3a;

a first calculation means 5 for calculating center coordinates of the contour based on the contour data;

a second step of calculating the area within the contour based on the contour data;
calculation means 6.

Among the areas calculated by the second calculating means 6, select the area to be stored in the register.

A second section for storing the contour area selected by the above-mentioned sui and chia.
and register 3b.

The third calculation means 8 calculates the rotation angle and rotation direction of the eyeball based on the contour area stored in the second register 7 and the contour area not stored in the second register 3b.

Next, follow the functions and operations of the configuration shown in Figure 1 in order.
explain. The reflected light a on the eyeball is 7 ya.

The signal is transmitted to the imaging unit 2 through the transmission line 1. Reflected light a at the imaging unit 2
is converted into an image signal and stored in the first register 33. Next, the image signal bK stored in the first register 3aK
The outline of the tunnel is extracted by the extracting means 4 which extracts outline data based on the information. As an extraction method, the contour of the tunnel is visualized on a monitor, and the contour data C of the tunnel is extracted from the difference in brightness.

The extracted canal contour looks like the conceptual diagram shown in FIG. 2, which shows the relationship between the rotation of the eyeball and the flattening of the canal contour. That is, when observed from the emmetropic direction of the eyeball, the contour of the foramen gradually moves from a circular shape in emmetropic vision to a flattened shape as the eyeball rotates. The present invention determines the eyeball movement from the flatness of the foramen outline and the moved position.

Based on the extracted tunnel contour data C, the first calculation means 5 calculates the central coordinates of the tunnel contour. FIG. 3 is a conceptual diagram showing the first calculation means 5, in which the process of checking the color tone one dot at a time parallel to the X-axis on the monitor is performed in the X-axis force direction.
Coordinates p(Xle)'1 of two points extracted by dot by dot and one dot whose color tone is different from the background wand.
), q(Xl −y2) is determined. These two points have the same slope and are tangent points of a straight line that touches the foramen contour C, so S
The midpoint (X3, ys) of 1jl1min pq coincides with the center point d (Xs, ys) of the fistula contour C. That is, it can be calculated using the following formula.

Xs = (Xt + Xz)/2. 'l3=(Yt
+Yx ) / 2...(3) The above method was obtained from the points of contact p and q with a straight line parallel to the The result is the same even if we find the contact point, and this data is used in the third
input into the calculation means 8.

- 1,000, during second calculation of extracted tunnel contour data C;
76, as shown in the conceptual diagram showing the means for calculating the area of the canal shown in Fig. 4, the color tone is examined one dot at a time parallel to the X axis, and the two points u and v darkness where the lines change are total number of dots l
The process of calculating y! By calculating the total number of dots inside the tunnel surrounded by the contour of the tunnel, the area e of the tunnel is calculated, and then the area of the tunnel is selected.

The aperture area S in normal vision is selected by chia and stored in the second register 3b.

Next, the ocular foramen area 5 (e=8+8o
) is input to the third calculation means 8 which calculates the rotation angle θ and rotation direction β of the eyeball.

The conceptual diagram showing the geometrical relationship between the eyeball rotation angle and the flattened foramen contour shown in FIG. 5 is constructed using the following equation.

8゜=πr2 ・River... (4) S =
xr cosθ −・−−−−(5) Therefore,
θ = cor”' G (6) Here, r is the diameter of the foramen in normal vision.

From equation (5), it can be seen that the eyeball rotation angle θ is proportional to S/So, which is one parameter representing the amount of flattening of the foramen contour. Also, the rotation direction β is the center coordinate d of the tunnel contour.
(Xs, ys) can be calculated using the following formula.

β= sin'-'(X3/F;'+sys')
・・・=・ (Force) The point to be especially careful here is that the eyeball rotation angle θ uses the center of the foramen outline (X3.ys),
This can also be obtained from the following equation.

I b=m 5in-1 ((E; 'stone π shi m')
(8) Here, m' is the distance from the center of rotation of the eyeball to the foramen. If the eyeball rotation angle θ is calculated using equation (8),
It is no longer necessary to calculate the foramen area, but the eyeball dimension m′
In addition, the disadvantage of having to be determined in advance by another device like the test subject cannot be overcome, and the eyeball dimension nl' cannot be measured directly, but is calculated indirectly using the Hashira's device, so there is a large error. , the formula ta using this line is
) has the disadvantage that an error occurs between the actual U-sphere rotation angle θ and the actual U-sphere rotation angle θ.

Equation 18) The major difference between K and Equation (6) is that there are no dimensions that must be determined in advance by another device for each subject and eyeball dimensions that can only be measured indirectly, which can cause errors. It is.

〔Effect of the invention〕

The eye movement detection device of the present invention indirectly calculates the rotation angle θ of the eyeball from the movement of the eye mark imaged on the 1ilt sphere. Since the eyeball rotation angle θ and the rotation direction β can be calculated by directly measuring the flatness of the contour of the canal and the direction of the moving force, it is possible to accurately detect eyeball movements up to the heel diameter of 111t. There is. Furthermore, there is an effect that there is no need to calculate the eyeball dimension parameters for each subject in advance using a separate device, and in addition, there is an effect that the device can be simplified because there is no need to image the eye mark on the eyeball. .

[Brief explanation of the drawing]

FIG. 1 is a professional diagram showing one embodiment of the present invention, FIG. 2 is a conceptual diagram showing the relationship between rotation of the eyeball and flattening of the contour of the foramen, and FIG. 3 is a first calculation means. 5 is a conceptual diagram showing the area calculating means 6, FIG. 5 is a conceptual diagram showing the geometric relationship between the eyeball rotation angle and the amount of foraminal outline flattening, and FIG. 6 is a conceptual diagram showing the area calculation means 6. It is a block diagram showing an example. ]...7 y, ri, 2, mountain...imaging section, 3 a
@3 b*3C...Register, 4...
・Contour data extraction means, 5... Center coordinate calculation means, 6. River... Area calculation means, 7... Sui, Te, 8. River... Rotation angle and rotation direction of the eyeball calculation means,
9...Means for forming an image of the eye mark on the eyeball, 1
0... Eye mark coordinate point extraction means, 11...
. . . Eye mark rotation angle and rotation direction calculation means, a . . . Reflected light on the eyeball, b. River . . . image signal, C . . . Canal contour data, d ... Center point of the hole, e ... Hole area, f ...
・Incoming light to the eyeball, g...Eye mark, h...
...Reflected light from the eyeball, i...Image signal of the eye mark, j...Coordinate point of the eye mark, 1...
... Dot summary between two points where the color tone changes, scolding...
・Distance from the center of eyeball rotation to the center of corneal curvature, m′・
...Distance from the center of rotation of the eyeball to the foramen, n, river, iris, p, q... Point of contact between two parallel straight lines and the contour of the foramen, r...・Meridional diameter of the foramen in normal view, 5
o・Old...Foraminal area when looking straight ahead, S...
Canal area at any rotation angle, u, v...
・Both end points of line segment l, X, y, ...X, y of point p
VM mark, Xz, y2...X, y coordinates of point q,
x, , 3's...X at point d. y coordinate, y4...Y coordinate of points u and v, x, y
. ,...0. - X, y coordinates of point j, θ1...Rotation angle of eye mark, βl...Rotation direction of eye mark, θ, 99.・Rotation angle of the eyeball, I...
Rotational force direction of the eyeball. Imaya 2 Figures 3 Figures

Claims (1)

[Scope of Claims] A shutter, an imaging section, a first register for storing an image signal converted by the imaging section, and an extraction means for extracting contour data based on the image signal stored in the first register. , a first calculating means for calculating center coordinates of the contour based on the contour data, and a second calculating means for calculating an area within the contour based on the contour data.
a switch for selecting an area to be stored in a register from among the areas calculated by the second calculation means; a second register for storing the contour area selected by the switch; and a second register for storing the contour area selected by the switch. Eye movement detection characterized by comprising a third calculating means for calculating the rotation angle and rotation direction of the eyeball based on the contour area stored in the register, the contour area not stored in the second register, and the center coordinates. Device.