JPH01268538A - Sight data analyser - Google Patents

Abstract

PURPOSE:To simply adjust a zero point, by mounting a zero point detection circuit for outputting a bias signal and a zero point shift circuit for shifting the data outputted from an eye movement data input part to calibrate the zero point. CONSTITUTION:A zero point detection circuit 14 inputs data in both of horizontal and vertical directions from an eye movement data input part 7 and calculates the view point R detected by sensors 1, 2 on the basis of said data and, when said view point R is shifted from a zero point P0, the differences DELTAx, DELTAy between the zero point P0 and the viewpoint R in X- and Y-axis directions and the bias signals corresponding to said values are outputted to a zero point shift circuit 15. The zero point shift circuit 15 respectively adds or subtracts the biases corresponding to the differences DELTAx, DELTAy with respect to the data in both of horizontal and vertical directions outputted from the eye movement data input part 7 to calibrate the zero point and forcibly moves the view point R to the zero point P0 to output the data after calibration in the horizontal and vertical directions to a gain control circuit 17.

Description

[Detailed Description of the Invention] [Object of the Invention] (Field of Industrial Application) The present invention is a visual information analysis system that can detect the eye movements of a subject and display the viewpoint on a display! This is related to the A position.

(Prior Art) A device that detects eye movements, that is, eyeball movements of a subject, and displays a gaze point on a display or film has been developed as an eye camera, and the most common opportunity to see it is probably the driver's eye movement. There are various methods for detecting the subject's eye movements, such as a method using corneal reflected light, a method using the difference in reflectance between the cornea and sclera, a method using a contact lens, and an EOG method. The operating principle of a method that utilizes the difference in reflectance between the cornea (the iris of the eye) and the sclera (the white of the eye) will be explained with reference to FIG. Sensors 1 and 2 each having three elements arranged in parallel are placed in the left and right eyes. The center of these is the light emitting element 3, which uses a light emitting diode that emits infrared light with relatively wide directivity (approximately ±21°).

On both sides of this light emitting element 3 are light receiving elements 4, which use photodiodes with narrow directivity (approximately ±10'). The light projected from the light emitting element 3 to the eyeball has a different reflectance between the black eye and the white of the eye, and if this difference in reflectance is amplified and the difference is taken, it will be output in the horizontal (left and right) direction, and if the phase is taken, it will be output in the vertical (upward) direction. ) direction output. Then, by placing horizontal sensor 1 on the negative eye and vertical sensor 2 on the other eye, and using these simultaneously, two-dimensional eye movements can be detected and the viewpoint can be displayed on the display. , for example, the speed and direction of movement of the eyeball from such methods.

Japanese Unexamined Patent Publication No. 126140/1983 discloses information such as movement distance and gaze time.

(Problem to be Solved by the Invention) What is important in such a visual information analysis device is that the viewpoint detected by the sensors 1 and 2 and displayed on the display matches the object that the subject is gazing at. It is.

Therefore, before detecting eye movements, the subject is made to gaze at, for example, the center of the display, and at that time, the output of sensor 1 in the horizontal direction is zero, and the output of sensor 1 in the vertical direction is zero (or a predetermined value). The so-called zero point adjustment is performed by positioning the sensor 1.2, that is, the light emitting element 3, so that the sensor 1.2, that is, the light emitting element 3, is positioned so that the light emitting element 3 is adjusted. By the way, since these sensors 1.2 are very small, fine adjustment of this positioning is a very complicated task, and it is necessary to repeat this task twice for the left eye and the right eye. In addition, since these sensors 1 and 2 are attached to the eyeglass frame together and worn on the face, even after the adjustment of one sensor 1 is completed, the adjustment of the other sensor 2 may be completed. This positioning was a difficult task even for an experienced person because the position of the sensor 1 of the subject may shift, and the shape of the eyes and the distance between the eyes may vary depending on individual differences among subjects. Further, even after adjustment, the adjustment may deviate due to movement of the subject, and it is necessary to interrupt the measurement and perform complicated readjustment each time.

The present invention has been made based on the above problem, and is it possible to easily perform zero point adjustment? J! The purpose is to provide an information analysis device.

[Configuration of the Invention] (Means for Solving the Problems) A first configuration of the present invention includes an eye movement data input unit that detects eye movement, and an eye movement data input unit that detects when an arbitrary zero point is gazed. a zero point detection circuit that calculates the difference between the data to be displayed and this zero point and outputs a bias signal according to this difference; and a zero point detection circuit that shifts the data output from the eye movement data input section according to this bias signal. It is equipped with a zero point shift circuit for zero point calibration.

A second configuration of the present invention includes an eye movement data input section that detects eye movement, and an amplitude of fluctuation of at least two pieces of data detected by the eye movement data input section when gazing at at least two arbitrary points. a dynamic range detection circuit that calculates a ratio between the amplitude of vibration between the two points and outputs a gain signal according to this ratio; and a dynamic range detection circuit that calculates a ratio between the two points and outputs a gain signal according to the ratio, and adjusts the gain of the data output from the eye movement data input section according to this gain signal. and a gain control circuit that performs range calibration.

A third configuration of the present invention includes an eye movement data input section that detects eye movement, and when gazing at an arbitrary zero point, a difference between data detected by the eye movement data input section and this point is determined, and this difference is obtained. A zero point detection circuit that outputs a bias signal according to the bias signal, and a zero point detection circuit that outputs a bias signal according to the bias signal. a zero point shift circuit for zero point calibration by shifting data output from the eye movement data input section; and at least two data fluctuations detected by the eye movement data input section when gazing at at least two arbitrary points. A dynamic range detection circuit that calculates the ratio between the width and the amplitude of the fluctuation between the two points and outputs a gain signal according to this ratio, and a dynamic range detection circuit that calculates the ratio of the amplitude of the amplitude between the two points and outputs a gain signal according to this ratio; and a gain control circuit that adjusts and calibrates the range.

(Function) In the first configuration, the zero point and the zero viewpoint based on the data detected by the eye movement data input unit when gazing at this zero point are compared, and each bias is applied according to the difference in the horizontal and vertical directions. Zero point calibration is performed by generating the bias and adding or subtracting this bias to the data output from the eye movement data input section and shifting the data.

In the second configuration, the amplitude of fluctuation between any two points is compared with the amplitude of fluctuation between two viewpoints based on data detected by the eye movement data input unit when gazing at these two points, and the ratio between these two points is calculated. Range calibration is performed by adjusting the gain of the data output from the eye movement data input section accordingly.

In the third configuration, zero point calibration and range calibration are performed by adding or subtracting the bias to and shifting the data output from the eye movement data input unit and adjusting the gain. The object is matched with the viewpoint based on the detected data.

(Example) Hereinafter, an example of the present invention will be described in detail based on the drawings. In FIG. 1, 1 is a horizontal sensor that detects the movement of the eyeball in the horizontal direction, 2 is a vertical sensor that detects the movement of the eyeball in the vertical direction, and like the conventional example shown in FIG. 5, there is a light emitting element in the center. 3 and light receiving elements 4 are provided on both sides thereof. The light-receiving element 4 of the horizontal sensor 1 is connected to a subtracter 5 and the difference between their outputs is obtained to obtain data in the horizontal direction, and the light-receiving element 4 of the vertical sensor 2 is connected to an adder 6 to obtain horizontal data. Vertical data is obtained by summing the outputs.

These sensors 1 and 2, the subtracter 5, and the adder 6 constitute an eye movement data input section 7, and these data are input to A.
/D converted and output. 8 is a calibration instruction circuit that displays a predetermined calibration pattern shown in FIG. 2 on the display 9 during calibration and instructs the subject to view it; for example, at every preset time by a timer 10 or by a switch 11 that the subject can operate himself. Alternatively, each point P of the calibration pattern can be adjusted using a remote switch 12 or the like that can be operated by the experimenter.
+, P+, P2, Ps, and P4 are sequentially displayed as - points, and the buzzer 13 is sounded to instruct the user to look at these points.

14 indicates the zero point Po on the display 9 by the calibration instruction circuit 8, and when the subject sees this point P-, the sensor 1
．． Input the eye movement data consisting of horizontal direction data and vertical direction data detected by 2, and calculate the difference △ from point P in the horizontal direction (X-axis direction) and vertical direction (Y-axis direction).
This is a zero point detection circuit that determines X and Δy and outputs a bias signal corresponding to these.

15 is ΔX, Δ output from this zero point detection circuit 14
This is a zero point shift circuit that performs zero point calibration by adding or subtracting a bias signal corresponding to y to the horizontal direction data and vertical direction data respectively output from the eye movement data input section 7. 16 After the zero point detection circuit 14 detects the zero point, the calibration instruction circuit 8 shows the right point P+, left point P2 . Upper point P3. The lower point P4 is sequentially displayed, and when the subject looks at these points P+ to P4, each horizontal direction and vertical direction data outputted from the eye movement data input section 7 is detected and stored, and the data is displayed on the display 9. The amplitude of the deviation between the right point P1 and the left point P2 and the upper point P
The difference between the swing width between 3 and the lower point P4 and the 8 swing width of the stored horizontal and vertical data when looking at these points is determined as a gain (ratio), and the difference between the horizontal and vertical directions is calculated as a gain (ratio). This is a dynamic range detection circuit for calibrating the range and obtaining the dynamic range. 17 is a gain control circuit that adjusts the gain by changing the amplification factor of the horizontal and vertical data output from the zero point shift circuit 15 to appropriate values based on the gain determined by the dynamic range detection circuit 16; It is. 1
8 is this gain 1IJll! Based on the horizontal and vertical direction data calibrated and output from l@11817, the viewpoint of the object that the subject is gazing at is determined and displayed on the display 9, stored in a recorder, etc., or subjected to various processing and processing. This is the eye movement data output unit to be analyzed. The calibration instruction circuit 8 outputs a calibration pulse to the zero point detection circuit 14 and the dynamic range detection circuit 16 to synchronize them, and the calibration instruction circuit 8 indicates the zero point Po and points P1 to P4, respectively. Sometimes horizontal and vertical data can be detected.

The operation of the present invention configured as described above will be explained with reference to FIGS. 2 to 4. When the subject looks straight at the zero point P6, which is the center of the display 9 in FIG. 3, of the calibration pattern shown in FIG. If the horizontal direction data detected by the light receiving element 4 that receives the light reflected from the eyeball is zero and the vertical direction data is zero (or a predetermined Wi), the subject's viewpoint number determined from these data is the zero point. It will match P.

However, since the shape of the eyeballs and the distance between the two ocular floors differ depending on the subject, when wearing the glasses frame in which these sensors 1 and 2 are attached at predetermined positions, it is difficult to look straight at the zero point P0. However, depending on the individual, the horizontal or vertical data will not necessarily be zero;
The zero point Po and the viewpoint will not match. Therefore, calibration is required to match them. This calibration is
When the subject has loaded the glasses frame with the sensors 1 and 2 attached, the calibration instruction circuit 8 first displays the zero point Pa on the display 9 as shown in FIG.・Make people pay close attention to. At this time, the zero point detection circuit 14 inputs the horizontal direction and vertical direction data from the eye movement data input section 7, and based on these, determines the viewpoint R detected by the sensors 1 and 2. As shown in the figure, if it deviates from the zero point P◇, the U exit point P and viewpoint R in the X-axis direction and Y-axis direction, respectively.
The difference ΔX and Δy are calculated, and bias signals corresponding to these values are output to the zero point shift circuit 15. The zero point shift circuit 15 adds a bias corresponding to ΔX to the horizontal direction data outputted from the eye movement data input section 7, and a bias corresponding to Δy to the vertical direction data, respectively, or subtracts it by t to set the zero point. The horizontal direction data and vertical direction data after this calibration are outputted to the gain control circuit 17. After the zero point calibration, the calibration instruction circuit 8 sequentially moves the viewpoint R to the zero point Pa. . Point P
2, the viewpoints determined by the horizontal and vertical data output by the eye movement data input section 7 are R+ and R2, respectively. Therefore, the dynamic range detection circuit 16 detects the amplitude A of points R+ and R2 and the amplitude A of points P1 and P.
2 with the amplitude 8 as a gain (ratio), output this gain to the gain III a11 circuit 17, and amplify the horizontal direction data output from the zero point shift 1 to circuit 15 with this gain. Accordingly, the horizontal range of the display 9 can be calibrated with the range of the detected horizontal data, and a dynamic range can be obtained. In this way, by detecting the difference in the can width between two points in the horizontal direction and amplifying the horizontal direction data from the eye movement data input section 7 with the detected gain, the sensor 1.2 detects the difference in can width. The movement of the eyeballs can be displayed in accordance with the range of the display 9.

Note that a dynamic range can be obtained by similar calibration in the vertical direction, and by calibration in the horizontal and vertical directions, it is possible to accurately match the movement of the eyeball to the object that the subject is gazing at.

In this way, zero point calibration and range calibration are performed by displaying the calibration pattern, and the horizontal and vertical direction data output from the eye movement data input section 7 are processed automatically using the obtained bias and gain. Adjustments are made for individual differences between subjects, eliminating the need for complicated assisted adjustments by experts to position the sensors 1 and 2 as in the past, simplifying zero point adjustment and making it easier to detect eye movements. .

Moreover, even if the position of the sensor 1.2 is shifted after mounting, the calibration pattern can be displayed again and calibration can be performed, so that the experiment can be interrupted in a short time.

Although one embodiment of the present invention has been described in detail above, it can be modified as appropriate within the scope of the gist of the present invention. For example, in the above embodiment, Sen 4J1゜2 is placed in front of the left and right eyes, respectively,
Although the method for obtaining horizontal and vertical data using both eyes has been shown, the present invention can also be applied to obtaining these data using a monocular eye. In addition, as for the eye movement data input section 7, a method of detecting eye movement using the difference in reflectance between the cornea and sclera has been shown, but other methods such as a method using corneal reflected light can also be applied. can. Furthermore, the timer 10# switch 11. is used to display the calibration patterns one by one. Any one of the remote switches 12 may be used.

〔Effect of the invention〕

As detailed above, according to the present invention, the difference between an arbitrary zero point and the zero viewpoint when gazing at this zero point is determined, and the detected eye movement data is shifted by a bias according to this difference. This performs zero point calibration. Also,
Calculate the range by calculating the ratio between the amplitude of vibration between any two points and the amplitude of vibration between the two viewpoints when gazing at these two points, and adjusting the gain of the detected eye movement data according to this ratio. will be held. Furthermore, by combining these zero point calibrations and range calibrations, it is possible to provide a visual information analysis device that can automatically and easily perform zero point adjustment.

[Brief explanation of the drawing]

Fig. 1 is a block diagram showing an embodiment of the present invention, Fig. 2 is an explanatory diagram showing a calibration pattern, Figs. 3 and 4 are explanatory drawings showing the operation, and Fig. 5 is a basic principle. It is an explanatory diagram. 7...Eye movement data input section 14...Zero point detection circuit 15...Zero point shift 1 to circuit 16...Dive range detection circuit 17...Gain series control circuit Patent applicant: Takei Kiki Kogyo Co., Ltd.
Representative of Japan Broadcasting Association Patent Attorney Ushiki
”■ Fig. 5, Fig. 27, Fig. 3, Fig. 4, exiting in the 7Kf direction.

Claims (3)

[Claims] (1) An eye movement data input unit that detects eye movement, and when gazing at an arbitrary zero point, the difference between the data detected by the eye movement data input unit and this zero point is determined, and a bias is applied according to this difference. Visual information comprising: a zero point detection circuit that outputs a signal; and a zero point shift circuit that calibrates the zero point by shifting data output from the eye movement data input section in accordance with the bias signal. Analysis equipment. (2) An eye movement data input unit that detects eye movement, and an amplitude of at least two pieces of data detected by the eye movement data input unit when gazing at at least two arbitrary points, and an amplitude of amplitude between the two points. a dynamic range detection circuit that calculates the ratio between the two and outputs a gain signal according to this ratio, and a gain control circuit that adjusts the gain of data output from the eye movement data input section in accordance with this gain signal to calibrate the range. A visual information analysis device comprising: (3) An eye movement data input section that detects eye movement, and when gazing at an arbitrary zero point, the difference between the data detected by the eye movement data input section and this point is determined, and a bias signal corresponding to this difference is generated. a zero point detection circuit that outputs a zero point detection circuit; a zero point shift circuit that calibrates the zero point by shifting data output from the eye movement data input section according to the bias signal; a dynamic range detection circuit that calculates a ratio between the amplitude of at least two pieces of data detected by the eye movement data input section and the amplitude of amplitude between the two points, and outputs a gain signal according to this ratio; A visual information analysis device comprising: a gain control circuit that performs range calibration by adjusting the gain of data output from the eye movement data input section in accordance with the above.