JP3242685B2 - Eye gaze measurement device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a line-of-sight measuring device used for analyzing a point of gaze of a driver, for example, a motorcycle or a car. The present invention relates to a line-of-sight measuring device that can accurately measure without being affected by movement.

[0002]

2. Description of the Related Art In recent years, with the development of motorization, many people drive motorcycles and automobiles. For this reason, as shown in FIG. 5, how the driver recognizes the traffic signs 2a and 2b and the surrounding dangerous objects 4 from what distance, and how this distance depends on the weather conditions and the state of vehicles running around the vehicle. There is a growing demand to analyze the driver's point of gaze, such as whether it will be changed, and utilize it for vehicle and road design. 2. Description of the Related Art Conventionally, various devices have been proposed for measuring where a person's line of sight is poured. For example, in JP-A-61-172552 and JP-A-3-109090, a parallel light beam from a light source is projected onto an eyeball of a subject, and a corneal reflection image and an image of a pupil formed by light reflected from the cornea. A method of performing gaze measurement using a position is disclosed.

[0003] Also, there is known an eye camera including a combination of a light emitting diode and a light receiving element that emit near infrared light. This eye camera irradiates a human eyeball with near infrared light and emits the eyeball. The reflected light from the protruding part is detected by the light receiving element,
It is used as an eye-gaze measuring device that calculates the movement of the eyeball and displays the gaze point of the gaze of the person to be measured in a visual field image captured by a video camera.

[0004] The displayed gazing point data is digital data as a moving angle amount from a reference position 6 in a two-dimensional coordinate system defined by a vertical axis V and a horizontal axis H when the subject is in a fixed posture. (FIG. 5).

In recent years, downsizing has progressed in components such as video cameras and eye cameras, and the components are small and can be incorporated in a driver's helmet or the like, and it has become possible to measure the line of sight during driving. .

[0006]

By the way, in the above-mentioned conventional line-of-sight measuring apparatus, it is assumed that the apparatus is used in a fixed posture. That is, if the position of the head of the subject is constant, it is possible to measure where in the visual field of the video camera the line of sight is focused, and to measure the distance to the viewpoint.

When measuring the line of sight of a driver of a motorcycle or car during driving, the distance between the head of the person to be measured and a horizontal reference line (horizontal line) can be measured in advance, and this is taken as the height from the horizontal line. Can be entered and set.

Therefore, as shown in FIG. 6, when the head 10 of the driver 8 is at a fixed position with respect to the horizontal line (horizontal reference line), the position of the eyeball is measured by the eye camera, that is, the position of the subject is measured. If the movement angle of the eyeball can be measured, the distance L1 from the measured value of the movement angle α to the gazing point P of the line of sight
Can be calculated by trigonometry, and it is possible to measure how far the driver 8 recognizes the traffic signs 2a and 2b and the dangerous substance 4 in FIG.

[0009] However, the position of the head 10 of the driver 8 during driving is not fixed to a fixed value, and as shown in FIG. In this case, the moving angle of the eyeball is α as in FIG.
Even if it does not change, since the angle of the head 10 with respect to the horizontal line (horizontal reference line) is different, the distance L2 to the gazing point P of the line of sight is different from that in FIG.

As described above, in the measurement of the line of sight of the driver 8, the conventional device that measures the position of the head of the person to be measured as a fixed position cannot accurately measure the distance to the driver's gazing point. Inconvenience will occur.

Therefore, the present invention accurately measures the distance to the gazing point of a driver, such as a motorcycle or a car, without being affected by the movement of the head position of the driver as the subject. It is an object of the present invention to provide a gaze measuring device capable of calculating the gaze.

[0012]

[0013]

SUMMARY OF THE INVENTION In order to achieve the above object, the present invention provides a gaze measuring apparatus for measuring a distance to a specific gaze point where a gaze of a person to be measured is poured. The eye-gaze measuring device detects a moving angle of the eyeball from a reference position when the head of the subject in a two-dimensional coordinate system in a vertical plane including the front-back direction is at a certain position, A visual field sensor that outputs visual field angle data at a period, and an angle sensor that detects a moving angle of the head of the subject from a horizontal reference line in the two-dimensional coordinate system and outputs the head angle data at a constant period. And a distance measuring device that generates a pulse signal each time the subject moves a predetermined reference distance;
And road surface conditions sensors reflectance and the road surface, which is set on the road surface in a particular fixation point for generating a pulse signal by detecting a different mark, the output is generated indicating movement of the eyeball from the field of view sensor, said distance The counting of the pulse signal from the measuring device is started, and when the pulse signal from the road surface condition sensor is generated, the counting of the pulse signal from the distance measuring device is terminated, the head angle data and the the counted based on the number of pulses, the measured person is the field of view
And an arithmetic circuit for calculating a distance from when the specific point of interest specified by the angle data is confirmed to when the mark reaches the mark.

[0014]

[0015]

[0016]

[0017]

According to the gaze measuring apparatus of the present invention, when the gaze point is ahead, the gaze moves from the road surface to the gaze point.
This movement of the line of sight is detected by a visual field sensor, for example,
If a mark with a different reflectance from the road surface is put on the side of the road such as a sign that is a specific point of gaze, the road surface condition sensor detects the mark when the vehicle passes by the sign and obtains a situation signal be able to.

Therefore, the distance signal pulse of the distance measuring device is counted until the visual line moves to the sign due to the change of the viewing angle data and the situation signal is detected, and the counted value is converted into the distance. The distance from the recognition of the sign to the passage of the sign can be measured.

In other words, it is possible to measure as a distance how far the subject has recognized the sign ahead of the vehicle as a distance. At the same time, the vehicle speed, the attitude of the rider (the subject) and the visual field in the view angle data are obtained. By accumulating data such as the angle of (sight), sufficient analysis data can be collected.

[0020]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, a preferred embodiment of the eye gaze measuring apparatus according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 shows a gaze measuring apparatus 20 according to this embodiment.
Reference numeral 22 is a visual field sensor that detects a moving angle of an eyeball from a reference position in a two-dimensional coordinate system when the head of the subject is at a fixed position. Reference numeral 24 denotes an angle sensor for detecting a moving angle of the head of the subject from a horizontal reference line, and reference numeral 26 denotes a line of sight of the subject based on detection outputs of the visual field sensor 22 and the angle sensor 24. This is an arithmetic circuit that calculates the horizontal distance to the gazing point that is lost.

The arithmetic circuit 26 includes a coordinate conversion circuit 26a for rotating the two-dimensional coordinate system based on the detection output of the angle sensor 24 and performing coordinate conversion, and a coordinate conversion circuit 26a based on the detection output of the visual field sensor 22. The converted two-dimensional coordinate system includes a distance calculation circuit 26b that calculates a horizontal distance to a gazing point at which the line of sight of the subject is poured.

Reference numeral 28 denotes a video camera which captures the field of view of the person to be measured and displays it on a display monitor 30. At this time, based on the horizontal distance to the gazing point of the measured person calculated by the arithmetic circuit 26, that is, based on the movement angle of the eyeball of the measured person detected by the visual field sensor 22, the measured value is measured by the display output means 32. Gaze point position data where the line of sight of the subject is poured in the field of view of the person is created,
It is displayed on the display monitor 30 as the point where the line of sight is being paid.

The horizontal distance to the gazing point of the subject calculated by the arithmetic circuit 26 is calculated by the data output means 3.
4, and can be recorded and stored in desired recording means.

The visual line measuring apparatus 20, which is basically constructed as described above, will now be described the operation.

The eye-gaze measuring device 20 is mounted on a helmet or the like worn on the head of the person to be measured. When the subject drives a motorcycle, a car, or the like, the visual field of the subject is captured by the video camera 28 and displayed on the display monitor 30.

The movement angle of the eyeball of the subject from the reference position is detected by the visual field sensor 22. When the subject is a motorcycle or automobile driver, the distance between the eye position of the subject and the horizontal reference line (horizontal line) can be measured in advance, and this can be input and set as the height from the horizontal line. As shown in FIG. 6, as long as the subject drives in a fixed posture, that is, as long as the subject's head is at a fixed position, the movement angle of the eyeball from the reference position in the two-dimensional coordinate system is If it can be measured, the horizontal distance to the gaze point at which the line of sight is poured can be easily calculated by trigonometry.

This calculation is performed by the distance calculation circuit 26b in the calculation circuit 26, and the calculation result is output to the data output means 34.
Can be output as digital data and can be recorded on desired recording means. Further, the display output means 32 outputs the data as display position data on the display monitor 30 and the field of view of the subject captured by the video camera 28. A gazing point at which the line of sight of the subject is focused is displayed on the image.

On the other hand, as shown in FIG. 7, when the posture of the subject changes and the head is bent forward, the angle of movement of the subject's head from the horizontal reference line is determined by the angle sensor 24. Is detected. Based on this detection result, the arithmetic circuit 26
The two-dimensional coordinate system is rotated by the middle coordinate conversion circuit 26a to perform coordinate conversion.

Based on the detection output of the visual field sensor 22, that is, the movement angle of the eyeball of the person to be measured, by the two-dimensional coordinate system converted in this manner, the distance calculation circuit 26b calculates the The horizontal distance to the gaze point at which the line of sight is poured is calculated.

The calculation result is similarly output from the data output means 34 as digital data, and can be recorded on a desired recording means.
As a result, the point of gaze at which the line of sight of the subject is focused is displayed on the visual field image of the subject, which is output as display position data on the display monitor 30 and captured by the video camera 28.

FIG. 2 is a schematic block diagram showing the configuration of the eye gaze measuring apparatus according to the present invention. 2, the line-of-sight measurement device 40 detects a moving angle of the eye from a reference position in the two-dimensional coordinate system when the head of the subject is in a fixed position, the field angle data seen at regular intervals A visual field sensor 42 for outputting, and an angle sensor 44 for detecting a moving angle of the head of the subject from a horizontal reference line in synchronization with the visual field sensor 42 and outputting the detected angle as angle data are provided.

Further, the line-of-sight measuring device 40 includes a distance measuring device 43 for generating a pulse signal each time a vehicle such as a motorcycle or a car on which the person to be measured moves a predetermined reference distance, and, for example, a road surface. A pulse signal is output as a white line signal for a mark attached on a road having a different reflectance,
A white line sensor 45 that detects a change in road surface condition based on a difference in reflectivity and generates a pulse signal, and a video camera 48 that captures an image of the field of view of the subject are provided.

The field sensor 42 and the angle sensor 4
4. The output signals of the distance measuring device 43 and the white line sensor 45 are recorded in the video recorder 47 in synchronization with the video signal of the field of view of the subject captured by the video camera 48, and the visual field image of the subject is output as an image. It can be displayed on the display monitor 50 through the section 49.

Further, the arithmetic circuit 46, the field sensor 42, the output is a visual field angle data indicating the movement of the eyeball of the subject is output, and starts counting the pulse signal from the distance measuring instrument 43 When a pulse output is generated from the white line sensor 45, the counting of the pulse signals from the distance measuring device 43 is terminated, and the distance is calculated based on the counted number of pulses. This calculation result can be displayed on the display monitor 50 through the data output unit 54 and the display output unit 52, or can be displayed as a graph on the graph display unit 56.

The eye gaze measuring apparatus 40 according to the present embodiment is basically configured as described above, and the operation thereof will be described next.

Normally, a rider (measured person) of a two-wheeled vehicle runs with his / her eyes on the road surface. For example, when traffic signs 2a and 2b are present ahead as shown in FIG. Move to signs 2a, 2b. This line of sight movement
It is detected by the visual field sensor 42 and is represented as a visual line movement on the visual field image.

Output signals B , A , C, D of the visual field sensor 42, the distance measuring device 43, the white line sensor 45, and the angle sensor 44.
Are recorded in the video recorder 47 in synchronization with the video signal, and the respective fields of view of the subject taken by the video camera 48 are recorded as waveforms as shown in FIG. visual field angle data interval sequential number for each are displayed.

Here, if a mark is put on a road beside the traffic signs 2a, 2b, etc., the vehicle can be moved to the traffic signs 2a, 2b.
When passing through the side of the white line sensor 45, the white line signal C
Can be obtained. Accordingly, the road surface is viewed at 1 in the viewing angle data B, and the line of sight moves to the sign at 2 until pulses 1 to 6 of the distance signal A of the distance measuring device 43 are detected until 1 of the white line signal C is detected. If the counted value is converted to a distance, the distance from the recognition of the traffic sign 2a, 2b to the passage of the traffic sign 2a, 2b can be measured.

In other words, it is possible to measure the distance from which the subject has recognized the traffic signs 2a, 2b in front from the front, and at the same time, to determine the viewing angle data B
Data such as the vehicle speed, the attitude of the rider (measured person), the angle of the visual field (line of sight), and the like in (2) are accumulated, so that sufficient analysis data can be collected.

FIG. 4 shows a flow chart for performing the above processing, focusing on the function of the arithmetic circuit 46.
Processing can be performed using a microprocessor. First, in step S1, the visual field sensor 42,
The output signals B , A , C, and D of the distance measuring device 43, the white line sensor 45, and the angle sensor 44 are input in synchronization with a video signal of the field of view of the subject captured by the video camera 48.

Next, in step S2, the viewing angle data B includes the number of the viewing angle data B when the line of sight of the rider (measured person) moves and the number of the white line signal, that is, 2 of the viewing angle data B. 1 of the white line signal C is input. In step S3, pulses 6 to 12 of the distance signal A of the distance measuring device 43 between the field angle data B of 2 and the white line signal C of 1 are counted, and in step S4. The distance is converted from the counted distance signal A.

In step S5, timer data (not shown) is counted from 2 of the viewing angle data B to 1 of the white line signal C. In step S6, the timer data is converted into time, and in step S7, An average speed is calculated from the distance and the time, and in step S8, each data of the viewing angle data B is read, and in step S9, these data are output.
Display.

[0044]

According to the gaze measuring apparatus according to the present invention, the following effects can be obtained. That is, the present invention converts a two-dimensional coordinate system in accordance with the amount of movement even when the position of the head of the subject moves, and the particular line of sight of the subject is focused on. The horizontal distance to the point of interest can be accurately calculated and recorded.

Also, even when the position of the head of the subject moves, the distance can be obtained by counting the distance measurement signals from the movement of the line of sight to the detection of the road surface condition signal without any influence. it can.

Therefore, the driver of a motorcycle or a car is equipped with the present apparatus, and while changing the weather condition or the state of a vehicle running around the vehicle, it is necessary to determine the distance from which a traffic sign and surrounding dangerous objects are recognized. By recording sequentially,
The driver's gaze point can be analyzed in detail, and the result can be used for vehicle and road design.

The present apparatus is not only used by actually being mounted on a driver, but also used in combination with computer graphic technology as an eye-gaze measuring apparatus in a simulation system for monitoring the behavior of a driver by arbitrarily changing the driving environment. It is also possible to use.

[Brief description of the drawings]

Is a block diagram showing an outline substantially arrangement of the line-of-sight measurement apparatus according to the present invention; FIG.

Is a block diagram showing the schematic structure of a real施例gaze measurement apparatus according to the present invention; FIG.

FIG. 3 is a diagram showing waveforms at various parts in the embodiment of FIG. 2;

FIG. 4 is a diagram showing a processing flowchart in the embodiment of FIG. 2;

FIG. 5 is a diagram showing a visual field image of a person to be measured.

FIG. 6 is a diagram for explaining the operation of the embodiment shown in FIG. 1;

FIG. 7 is a diagram for explaining the operation of the embodiment shown in FIG. 1;

[Explanation of symbols]

 20, 40 ... line-of-sight measuring device 22, 42 ... visual field sensor 24, 44 ... angle sensor 26, 46 ... arithmetic circuit 26a ... coordinate conversion circuit 26b ... distance calculation circuit 28, 48 ... video camera 30, 50 ... display monitor 32 ... display Output means 34 Data output means 43 Distance measuring device 45 White line sensor 47 Video recorder

Continuation of front page (56) References JP-A-2-224637 (JP, A) JP-A-4-288121 (JP, A) JP-A-3-192500 (JP, A) JP-A-60-126140 (JP) JP-A-1-185241 (JP, A) JP-A-4-288122 (JP, A) JP-A-4-288123 (JP, A) JP-A-61-172552 (JP, A) 3-109029 (JP, A) JP-A-5-108148 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) A61B 3/113

Claims (3)

(57) [Claims] 1. A gaze measuring device for measuring a distance to a specific point of gaze at which a gaze of a subject is poured, wherein the gaze measuring device is a two-dimensional coordinate in a vertical plane including a front-rear direction. A field-of-view sensor that detects an angle of movement of an eyeball from a reference position when a head of a subject in a system is at a fixed position, and outputs viewing angle data at a fixed cycle; and a horizontal reference in the two-dimensional coordinate system. An angle sensor that detects the movement angle of the head of the subject from the line and outputs head angle data at a fixed cycle; and a pulse signal every time the subject moves a predetermined reference distance. shows a distance measuring device for generating a road surface condition sensor reflectance and the road surface, which is set on the road surface in the particular gaze point generates a pulse signal by detecting a different mark, the movement of the eyeball from the field sensor When output is generated Starts counting of the pulse signal from the distance measuring instrument, when the pulse signal from the road surface condition sensor is generated, and ends the counting of the pulse signal from the distance measuring instrument, the head angle data And based on the counted number of pulses ,
And an arithmetic circuit for calculating a distance from the confirmation of the specific point of gaze specified until the mark reaches the mark. 2. The eye-gaze measuring device according to claim 1, wherein the visual field sensor is configured to be mounted on the head of the person to be measured. 3. The eye-gaze measuring device according to claim 1, wherein the eye-gaze measuring device is configured to be mounted on a head of a person to be measured, and a video for recording an image captured by the video camera. A gaze measuring device, comprising: a recorder; a field sensor, an angle sensor, a distance measuring device, and an output signal of a road surface condition sensor recorded in the video recorder in synchronization with a video signal captured by the video camera. apparatus.