JP2023066924A - Gaze information processing device, gaze information processing method and program for gaze information processing - Google Patents

Abstract

To provide a gaze information processing device or the like capable of preventing a driver from making a mistake in the road to proceed even at the intersection with a complex structure.SOLUTION: A gaze information processing device includes: a gaze sensor 1 for acquiring the gaze information indicating the gaze of a driver of a vehicle; an interface 2 for acquiring the intersection information including the position information indicating a position of an intersection where the vehicle should turn and where there are multiple roads branching to the side where the vehicle should turn, and the proceeding road information indicating the road where the vehicle should proceed through the intersection; and a determination part 3 which, based on the acquired gaze information and intersection information, determines the difference between the position of the proceeding road and the position of the viewpoint in the gaze before the vehicle reaches the intersection.SELECTED DRAWING: Figure 2

Description

The present application belongs to the technical field of a line-of-sight information processing device, a line-of-sight information processing method, and a line-of-sight information processing program. More specifically, a line-of-sight information processing apparatus and line-of-sight information processing method for performing processing using line-of-sight information indicating the line-of-sight of a passenger of a moving body such as a vehicle, and a line-of-sight information processing program used in the line-of-sight information processing apparatus. belongs to the technical field of

Conventionally, techniques for detecting the direction of a person's line of sight and the position of the line of sight (arrival position) have been developed, and along with this, techniques utilizing line-of-sight information including the detection results have also been developed. As a prior art document disclosing an example of such prior art, there is a technique described in Patent Document 1 below, for example.

The prior art described in this Patent Document 1 provides a route guidance device or the like that enables a driver to reliably travel on a fork road to which he or she should go without getting lost even at an intersection with a complicated structure. It is intended to Then, in the related art, the destination of the vehicle is set, it is determined whether or not the visual behavior of the driver for the route guidance to the destination is correct, and if the visual behavior is correct, it is affirmative, and if it is not correct, it is determined. In some cases, the driver is visually guided to guide the route.

JP 2004-037149 A

However, in the conventional technology described in Patent Document 1, the direction of the line of sight of the driver and the direction of the target object (building, facility, etc.) in the vicinity of the road to be traveled or the branch point (intersection) to the road , but the point at which the line of sight reaches (the position of the viewpoint in the line of sight) is not considered at all. In this case, at intersections on roads in Japan that have a complicated structure for left or right turns, such as intersections that branch into three directions: left front, left turn direction, and left rear. However, there is a problem that it is not possible to judge whether or not the road on which the vehicle should travel is correctly visually recognized.

Therefore, the present application has been made in view of the above problems, and one example of the problem is to prevent the driver from making a mistake in which road to proceed even at an intersection with a complicated structure as described above. To provide a line-of-sight information processing device, a line-of-sight information processing method, and a line-of-sight information processing program used in the line-of-sight information processing device.

In order to solve the above-mentioned problems, the invention according to claim 1 provides a line-of-sight information acquiring means for acquiring line-of-sight information indicating the line of sight of a driver of a vehicle, and an intersection at which the vehicle should turn at an intersection where the vehicle should turn. Acquiring intersection information including position information indicating the position of an intersection with a plurality of roads branching off to the right side, and traveling road information indicating the traveling road, which is the road on which the vehicle should proceed via the intersection. Based on intersection information acquisition means, the acquired line-of-sight information, and the acquired intersection information, the difference between the position of the traveling road and the position of the viewpoint in the line of sight is determined when the vehicle reaches the intersection. and determination means for determining before performing.

In order to solve the above-mentioned problems, the invention according to claim 7 is a line-of-sight information processing method executed in a line-of-sight information processing apparatus comprising line-of-sight information acquisition means, intersection information acquisition means, and determination means. a line-of-sight information acquisition step of acquiring line-of-sight information indicating the line of sight of the driver of the vehicle by the line-of-sight information acquisition means; an intersection information obtaining step of obtaining, by the intersection information obtaining means, intersection information including position information indicating the position of the intersection and traveling road information indicating the road on which the vehicle should proceed via the intersection; and, based on the obtained line-of-sight information and the obtained intersection information, the difference between the position of the traveling road and the position of the viewpoint in the line of sight is detected before the vehicle reaches the intersection. and a determining step of determining by a determining means.

In order to solve the above-mentioned problems, the invention according to claim 8 comprises a computer, line-of-sight information acquisition means for acquiring line-of-sight information indicating the line of sight of the driver of the vehicle, Intersection information including position information indicating the position of an intersection with a plurality of roads that diverge to the side where the vehicle should turn, and traveling road information indicating the traveling road that the vehicle should travel through the intersection. Based on the acquired intersection information acquisition means, the acquired line-of-sight information, and the acquired intersection information, the vehicle determines the difference between the position of the traveling road and the position of the viewpoint in the line of sight. It functions as determination means for determining before reaching an intersection.

1 is a block diagram showing a schematic configuration of a line-of-sight information processing apparatus according to an embodiment; FIG. 1 is a block diagram showing a schematic configuration of a guidance device that performs guidance processing according to an embodiment; FIG. It is a flow chart which shows guidance processing of an example, (a) is a flow chart which shows the whole guidance processing concerned, and (b) is a flow chart which shows the details of the guidance processing concerned. It is a figure which illustrates the guidance process of an Example.

Next, the form for implementing this application is demonstrated using FIG. Note that FIG. 1 is a block diagram showing a schematic configuration of the line-of-sight information processing apparatus of the embodiment.

As shown in FIG. 1 , the line-of-sight information processing apparatus S of the embodiment includes line-of-sight information acquisition means 1 , intersection information acquisition means 2 , and determination means 3 .

In this configuration, the line-of-sight information acquisition means 1 acquires line-of-sight information indicating the line of sight of the driver of the vehicle.

On the other hand, the intersection information acquisition means 2 provides position information indicating the position of the intersection where the vehicle should turn and which has a plurality of roads branching off to the side where the vehicle should turn, and the position information indicating the position of the intersection where the vehicle travels via the intersection. Intersection information including traveling road information indicating the traveling road that is the above-mentioned road to be acquired.

Based on the line-of-sight information acquired by the line-of-sight information acquisition unit 1 and the intersection information acquired by the intersection information acquisition unit 2, the determination unit 3 determines the position of the traveling road and the position of the viewpoint in the line of sight. Differences are determined before the vehicle reaches the intersection.

As described above, according to the operation of the line-of-sight information processing device S of the embodiment, when the vehicle turns at an intersection with a plurality of roads branching to the side where the vehicle should turn, the position information of the intersection and the traveling road information are included. Based on intersection information and line-of-sight information of the driver of the vehicle, the difference between the position of the road to be traveled and the position of the viewpoint is determined before the vehicle reaches the intersection.

Therefore, for example, when the position of the viewpoint of the driver is different from the position of the road on which the driver should travel and the road on which the driver should travel is likely to be mistaken, it is possible to notify the difference in advance.

Next, specific examples corresponding to the above-described embodiments will be described with reference to FIGS. 2 to 4. FIG. The embodiment described below is a guide route that is set in advance for guiding the movement of vehicles and includes a guide route that includes an intersection with a complicated structure (hereinafter simply referred to as a "complex intersection"). This is an embodiment in which the present invention is applied to guidance processing for guiding the vehicle to pass through the intersection when the movement is guided along the road.

FIG. 2 is a block diagram showing a schematic configuration of a guidance device that performs the guidance processing of the embodiment, FIG. 3 is a flowchart showing the guidance processing, and FIG. 4 is a diagram illustrating the guidance processing. At this time, in FIG. 2, for each component of the example corresponding to each component of the line-of-sight information processing apparatus S of the embodiment shown in FIG. I am using

As shown in FIG. 2, the guidance device SS of the embodiment mounted on a vehicle moving along the guidance route includes a line-of-sight sensor 1 for detecting the line-of-sight of the driver of the vehicle, an interface 2, and a CPU ( Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory) etc. processing unit 10, HDD (Hard Disc Drive) or SSD (Solid State Drive) etc. nonvolatile recording unit 11, An operation unit 12 including operation buttons or a remote controller, an in-vehicle microphone 13 that collects sounds and voices inside the vehicle, a camera 14, a sensor unit 15 including a GPS (Global Positioning System) sensor, for example, and a liquid crystal It is composed of a display 16 such as a display and a speaker 17 . At this time, the camera 14 is an in-vehicle camera that images the driver or the like and an exterior camera that images the surroundings outside the vehicle, each of which is a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor) imaging device. It includes an in-vehicle camera and an exterior camera consisting of, etc. In the following description, the vehicle equipped with the guidance device SS of the embodiment is simply referred to as "own vehicle".

Also, the processing unit 10 is configured by a determination unit 3 , a line-of-sight detection unit 4 , and a guidance unit 5 . At this time, the determination unit 3, the line-of-sight detection unit 4, and the guidance unit 5 may be realized by a hardware logic circuit such as the above-described CPU that constitutes the processing unit 10, or a flow chart showing the guidance processing of the embodiment described later. It may be realized in software by reading out the corresponding program from the recording unit 11 and executing it. The line-of-sight sensor 1 corresponds to an example of the line-of-sight information acquisition means 1 of the embodiment, the interface 2 corresponds to an example of the intersection information acquisition means 2 of the embodiment, and the determination section 3 corresponds to an example of the determination means 3 of the embodiment. Equivalent to. Further, the display 16 and the speaker 17 correspond to an example of the "notification means" of the present application, and the processing unit 10 corresponds to an example of the "detection means" and an example of the "behavior information acquisition means" of the present application, respectively. Furthermore, as indicated by the dashed line in FIG. 2, the line-of-sight sensor 1, the interface 2, and the determination unit 3 constitute an example of the line-of-sight information processing apparatus S of the embodiment.

In the above configuration, the line-of-sight sensor 1 detects the line-of-sight of the driver of the vehicle by a conventional method such as optical imaging of the driver's pupils, and the detection result is used as line-of-sight data by the processing unit. 10 to the line-of-sight detection unit 4 . At this time, the configuration of the line-of-sight sensor 1 and the line-of-sight detection method itself are basically the same as those of the conventional line-of-sight sensor. The line-of-sight data also includes line-of-sight direction data indicating the direction of the detected line of sight, and viewpoint position data indicating the position of the viewpoint as the reaching point of the line of sight. At this time, the line-of-sight data should include at least the line-of-sight direction data.

On the other hand, the interface 2 transmits route data indicating the guidance route, position data indicating the positions of the complicated intersections included in the guidance route, and intersection structure data indicating the structure of the intersections to an external network (not shown) such as the Internet. , and outputs the acquired route data and the like to the determination unit 3 and the guidance unit 5 . Here, specifically, as the intersection structure data, for example, the intersection structure data includes, for each lane constituting a road including the intersection, a branch line indicating the number of roads branching from the intersection. It includes road number data, road identification data for identifying each branching road, and road direction data indicating the direction in which each road branching from the intersection extends. In addition, the interface 2 acquires various data necessary for executing the guidance processing of the embodiment via the external network and outputs the data to the processing unit 10 . The route data, the position data, the intersection structure data, and the various data are pre-recorded in the recording unit 11, and the determining unit 3 and the guiding unit 5 acquire them via the interface 2 or directly. may be configured.

On the other hand, the outside camera of the camera 14 takes an image of the surroundings, generates outside image data as the image pickup result, and outputs the image data to the line-of-sight detection unit 4 and the processing unit 10 . Similarly, the in-vehicle camera of the camera 14 images the driver or the like, generates in-vehicle image data as the imaging result, and outputs the data to the line-of-sight detection unit 4 and the processing unit 10 .

Furthermore, the in-vehicle microphone 13 collects the sound generated inside the vehicle (hereinafter, the sound is referred to as “in-vehicle sound”), generates vehicle interior sound data, and outputs the data to the processing unit 10 . At this time, the vehicle interior sound includes, for example, a sound intermittently generated inside the vehicle due to the operation of the blinker of the own vehicle (the sound is hereinafter referred to as a "blinker sound").

Based on the line-of-sight data from the line-of-sight sensor 1, the vehicle-exterior imaging data from the vehicle-exterior camera, and the vehicle-interior imaging data from the vehicle-inside camera, the line-of-sight detection unit 4 detects the direction of the driver's line of sight and the position of the viewpoint. is detected, and the detection result is output to the determination unit 3 . At this time, if the line-of-sight data includes only the line-of-sight direction data, the line-of-sight detection unit 4 detects the position of the viewpoint by also using the outside image data.

On the other hand, the determination unit 3 determines the result of detection by the line-of-sight detection unit 4, and the route data, the position data, and the intersection structure data (the branch road number data, the road identification data, and the road direction) acquired via the interface 2. data, etc.), the direction of the line of sight and the position of the viewpoint of the driver of the vehicle, and the road on which the vehicle should proceed after passing through the above-mentioned complicated intersection (hereinafter referred to as the "travel road") ) is determined before the host vehicle reaches the complicated intersection, and the determination result is output to the guidance section 5. The determination of the difference by the determination unit 3 will be described in detail later.

On the other hand, the sensor unit 15 generates current position data indicating the current position of the vehicle and traveling direction data indicating the traveling direction of the vehicle using the GPS sensor or the like, and outputs the generated data to the guide unit 5 . In addition to this, the sensor unit 15 acquires behavior data indicating the behavior of the own vehicle such as operation of the blinker, for example, via an in-vehicle network or the like, and outputs the acquired behavior data to the guide unit 5 .

Further, the operation unit 12 receives an operation by the driver or the like who operates the guidance device SS, and outputs an operation signal corresponding to the received operation to the processing unit 10 . In addition to the route information and intersection structure data, the recording unit 11 nonvolatilely records various data including the program for causing the processing unit 10 to execute the guidance processing of the embodiment. Furthermore, the display 16 and the speaker 17, under the control of the processing unit 10, not only inform the driver of the above-described difference, but also perform display or audio output necessary for the guidance processing of the embodiment. At this time, the information providing process of the embodiment is executed based on the operation signal.

As a result, the guide unit 5 uses the determination result from the determination unit 3, the current position data, the traveling direction data, the behavior data, etc. from the sensor unit 15 to guide the vehicle through the complicated intersection. Execute the example guidance process for passing through the street. The guidance processing will also be described in detail later.

Next, the guidance processing of the embodiment executed mainly by the processing unit 10 will be specifically described with reference to FIGS. 2 to 4. FIG. It should be noted that the guidance process of the embodiment is started, for example, at preset time intervals after the host vehicle starts moving. Further, in the guidance processing of the embodiment described below, the route data indicating the guidance route along which the movement of the own vehicle should be guided, the position data and the intersection structure of the complex intersections included in the guidance route, It is assumed that the data (including the branch road number data, the road identification data, the road direction data, etc.) are acquired in advance by the determination unit 3 and the guidance unit 5, respectively.

As the entire corresponding flowchart is shown in FIG. Based on the data and the in-vehicle image data, the direction of the line of sight and the position of the viewpoint of the driver are detected, and the detection result is output to the determination unit 3 (step S1). In parallel with this, the guide unit 5 detects the current position of the vehicle along the guide route based on the current position data and the traveling direction data from the sensor unit 15 (step S1).

Next, based on the route data and the current position of the vehicle detected in step S1, the guide unit 5 determines whether there is a complicated intersection to turn right or left on the guidance route ahead of the vehicle in the moving direction. monitor (step S2). In step S2, if the complex intersection is not on the guidance route ahead (step S2: NO), the processing unit 10 proceeds to step S6, which will be described later.

On the other hand, if it is determined in step S2 that the complex intersection is on the guidance route ahead (step S2: YES), the determination unit 3 and the guidance unit 5 determine the location data and the intersection structure data for the intersection. obtain (step S3). After that, the guide unit 5 calculates the distance from the current position of the vehicle to the intersection (more specifically, to the center of the intersection) based on the current position data (step S4).

Based on these, the determination section 3 and the guidance section 5 execute the guidance processing of the embodiment for the complex intersection (step S5).

More specifically, as shown in FIG. 3(b), the determination unit 3 first determines whether the driver of the own vehicle at a position before the complicated intersection can visually recognize the road after passing through the intersection. is determined based on, for example, the outside image data (step S50). If the travel road cannot be visually recognized in the determination of step S50 (step S50: NO), the determination unit 3 returns to step S50 and waits until the travel road becomes visible due to the progress of the own vehicle. On the other hand, if it is determined in step S50 that the traveling road is visible (step S50: YES), the determination unit 3 next determines the line-of-sight direction data, the viewpoint position data, the position data, and the intersection structure data. Based on this, it is determined whether or not the position of the driver's viewpoint and the position of the traveling road match (step S51). At this time, when the position of the driver's viewpoint and the position of the traveling road match for a preset threshold time (for example, one second), the determination unit 3 determines that the positions match. .

If it is determined in step S51 that the position of the driver's viewpoint and the position of the traveling road do not match (step S51: NO), the guide unit 5 corrects the position of the viewpoint and allows the driver to visually recognize the traveling road. The user is guided by a voice through the speaker 17 or a display on the display 16 (step S52). After that, the determination unit 3 returns to step S51 to confirm again whether the position of the driver's viewpoint and the position of the traveling road match.

Here, the visual correction guidance in step S52 will be specifically described with reference to FIG. That is, as shown in FIG. 4, there is a complex intersection CR in front of the vehicle TC.At this intersection CR, roads R1 and R2 intersect each other. Road R3 (left front) and road R4 (left front) extend beside the intersection CR on the left side. It is also assumed that the traveling road on which the own vehicle TC should travel through the intersection CR is the road R3. At this time, if the position of the viewpoint of the driver of the vehicle TC is the position of the viewpoint PE1 of the incorrect line of sight EL1 (indicated by the broken line in FIG. 4) in the determination of step S51 (step S51: NO), the guidance The unit 5 corrects the line of sight of the driver by a guidance voice such as, for example, "That road is not the one. This is a road that bends diagonally to the left one ahead" (step S52). Further, in the determination of step S51, if the position of the viewpoint of the driver of the vehicle TC is the position of the viewpoint PE2 of the incorrect line of sight EL2 (indicated by the broken line in FIG. 4) (step S51: NO), the guide unit 5 corrects the line of sight of the driver by a guidance voice such as, for example, "This is not the road. It is a road that turns diagonally to the left two ahead ahead" (step S52).

On the other hand, in the determination of step S51, the position of the driver's viewpoint (viewpoint PC of the line of sight LCC (indicated by a solid line) illustrated in FIG. 4) and the position of the traveling road (road R3 illustrated in FIG. 4) match. If so (step S51: YES), the guide unit 5 checks the correctness of the position of the driver's viewpoint, as well as line-of-sight data indicating the driver's line of sight looking at the rear-view mirror (especially the side mirror or the door mirror) of the own vehicle. , based on the behavior data representing the operation of the blinker represented by the behavior data, or the voice such as "This is the road ahead on the left," or the vehicle interior sound data including the blinker sound. Guidance to the effect that the direction is correct is given by voice through the speaker 17 or display on the display 16 (step S53), and then the process proceeds to step S6 shown in FIG. 3(a). In this case, the guidance section 5 provides guidance by voice guidance such as, for example, "You are correct in that direction. Let's turn slowly."

When the complex intersection CR is safely passed through step S5, the post-processing unit 10 determines whether or not the guidance process of the embodiment should be terminated due to reasons such as the vehicle's arrival at the destination (step S6). ). When it is determined in step S6 that the guidance process is to be continued (step S6: NO), the processing unit 10 returns to step S1 and repeats the series of operations described above. On the other hand, if it is determined in step S6 that the guidance processing is to be terminated (step S6: YES), the processing unit 10 terminates the guidance processing as it is.

As described above, according to the guidance processing of the embodiment, when the own vehicle TC turns at a complex intersection CR (see FIG. 4) having a plurality of roads R2 to R4 branching to the side where the vehicle should turn, the intersection Before the vehicle TC reaches the intersection CR, the difference between the position of the road R3 to be traveled and the position of the viewpoint PC is determined based on the position data of the CR and the line-of-sight data of the driver of the vehicle TC. (See step S51 in FIG. 3B). Therefore, for example, when the position of the driver's viewpoint is different from the position of the road on which the driver should travel and the road on which the driver should travel is likely to be mistaken, it is possible to notify the difference in advance.

Also, when the position of the road R3 (see FIG. 4) to be traveled and the position of the viewpoint match for a specified time or longer, it is determined that the positions match (that is, there is no difference between the positions). Therefore (see step S51 in FIG. 3B), it is possible to determine the difference between the position of the road R3 to be traveled and the position of the viewpoint by a simple process using the threshold time.

Furthermore, when it is determined that there is a difference between the position of the road R3 to be traveled and the position of the viewpoint, the fact is notified (see step S52 in FIG. can be recognized before entering the intersection CR and the vehicle can be turned correctly at the intersection CR.

Furthermore, the fact that there is a difference between the position of the road R3 to be traveled and the position of the viewpoint, and the position of the road R3 to be traveled at the intersection CR are reported by voice guidance (see step S52 in FIG. 3B). ), the fact that there is a difference and the relationship between the intersection CR and the road R3 to be traveled can be specifically recognized by the driver.

Further, when it is detected that the vehicle TC is going to turn at the intersection toward the road R3 to be advanced based on the relationship between the position of the viewpoint and the position of the rear view mirror, it is notified that the traveling direction of the own vehicle TC is correct. (See step S53 in FIG. 3B), so that the own vehicle TC can be correctly guided.

Furthermore, it is detected that the vehicle is about to turn toward the road R3 to be traveled on the basis of the behavior of the own vehicle TC up to the complex intersection CR and the line of sight of the driver (see FIG. 3(b)). The own vehicle TC can be guided more correctly. At this time, the determination unit 3 and the guidance unit 5 may be configured to continue the guidance processing of the embodiment until the host vehicle TC enters the complex intersection CR.

In the above-described embodiment, the case where the passenger appears in the vehicle (four-wheeled vehicle) has been described. It is also possible to apply the guidance process of the embodiment to the guidance process being processed.

Furthermore, a program corresponding to the flowchart shown in FIG. 3 is recorded on a recording medium such as an optical disk or hard disk, or obtained via a network such as the Internet, and is read by a general-purpose microcomputer or the like. By executing this, it is possible to cause the microcomputer or the like to function as the processing unit 10 of the embodiment.

1 line-of-sight information acquisition means (line-of-sight sensor)
2 Intersection information acquisition means (interface)
3 Determination means (determination unit)
10 processing unit S line-of-sight information processing device SS guidance device TC own vehicle CR intersection PC, PE1, PE2 viewpoint LCC, EL1, EL2 line-of-sight

Claims (8)

line-of-sight information acquisition means for acquiring line-of-sight information indicating the line of sight of the driver of the vehicle;
Position information indicating the position of an intersection where the vehicle should turn and which has a plurality of roads that diverge to the side where the vehicle should turn, and a road on which the vehicle should proceed via the intersection. Intersection information acquisition means for acquiring intersection information including traveling road information indicating
Based on the obtained line-of-sight information and the obtained intersection information, a determination is made to determine the difference between the position of the traveling road and the position of the viewpoint in the line of sight before the vehicle reaches the intersection. means and
A line-of-sight information processing device comprising: In the line-of-sight information processing device according to claim 1,
The judging means judges that the position of the traveling road and the position of the viewpoint match when the position of the traveling road and the position of the viewpoint match for a preset threshold time or longer. A line-of-sight information processing device characterized by: In the line-of-sight information processing device according to claim 1 or claim 2,
A line-of-sight information processing apparatus, further comprising: notification means for notifying that there is a difference when it is determined that there is the difference. In the line-of-sight information processing device according to claim 3,
The line-of-sight information processing apparatus, wherein the notifying means notifies that there is a difference and the position of the traveling road at the intersection by a guidance voice. In the line-of-sight information processing device according to claim 3 or claim 4,
Detecting that the vehicle is about to turn at the intersection toward the traveling road based on the relationship between the position of the viewpoint indicated by the obtained line-of-sight information and the position of the rearview mirror of the vehicle. further comprising detection means;
The line-of-sight information processing apparatus, wherein the informing means, when it is detected that the vehicle is about to turn toward the travel road, informs that the traveling direction of the vehicle is correct. In the line-of-sight information processing device according to claim 5,
further comprising behavior information acquisition means for acquiring behavior information indicating the behavior of the vehicle within the intersection or up to the intersection;
The line-of-sight information, wherein the detecting means detects that the vehicle is about to turn at the intersection toward the traveling road based on the acquired line-of-sight information and the acquired behavior information. processing equipment. A line-of-sight information processing method executed in a line-of-sight information processing device comprising line-of-sight information acquisition means, intersection information acquisition means, and determination means,
a line-of-sight information acquiring step of acquiring line-of-sight information indicating the line of sight of the driver of the vehicle by the line-of-sight information acquiring means;
Position information indicating the position of an intersection where the vehicle should turn and which has a plurality of roads that diverge to the side where the vehicle should turn, and a road on which the vehicle should proceed via the intersection. and an intersection information acquisition step of acquiring intersection information including road information indicated by the intersection information acquisition means;
before the vehicle reaches the intersection, the difference between the position of the traveling road and the position of the viewpoint in the line of sight is determined based on the obtained line-of-sight information and the obtained intersection information; A determination step of determining by
A line-of-sight information processing method comprising: the computer,
line-of-sight information acquiring means for acquiring line-of-sight information indicating the line of sight of the driver of the vehicle;
Position information indicating the position of an intersection where the vehicle should turn and which has a plurality of roads that diverge to the side where the vehicle should turn, and a road on which the vehicle should proceed via the intersection. intersection information acquisition means for acquiring intersection information including traveling road information indicated by
Based on the obtained line-of-sight information and the obtained intersection information, a determination is made to determine the difference between the position of the traveling road and the position of the viewpoint in the line of sight before the vehicle reaches the intersection. means,
A viewpoint information processing program characterized by functioning as a

Images