JP2004053541A - Route guidance apparatus, route guidance method, and program for route guidance - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a route guidance apparatus etc. for determining whether an occupant has correctly recognized route instructions by speech on the basis of the occupant's behavior of visual recognition. <P>SOLUTION: The route guidance apparatus 1 is provided with the function of performing route guidance on a vehicle to a destination, and is provided with a route instruction means 14 for giving route instructions by speech on the occupant of the vehicle; a visual recognition behavior detecting means 36 for detecting the behavior of visual recognition of the the occupant of the vehicle; and a determining means 38 for determining whether the occupant has correctly recognized the route instructions on the basis of the result of detection of he visual recognition behavior detecting means. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a route guidance device, a route guidance method, and a route guidance program, and more particularly, to a route guidance device, a route guidance method, and a route guidance program for performing route guidance based on a visual recognition behavior of an occupant. About.
[0002]
[Prior art]
When a destination is set, an on-board route guidance device (navigation device) that sets an optimal route from the current position to the destination and guides the vehicle along the optimal route is widely used. As such a route guidance device, there is a device that executes a route instruction by voice in addition to an instruction of a traveling direction on a display screen.
[0003]
On the other hand, conventionally, a driver's line of sight has been detected using a camera (eye camera) mounted in front of a driver's seat of a vehicle, and switches of an air conditioner have been operated using the detected line of sight (Japanese Patent Application Laid-Open No. Hei 6-1994). JP-A-261863), the illumination direction of the headlight and the brightness of the meter display are adjusted according to the driver's visual recognition behavior (JP-A-9-76815), and the driver's driving operation is performed according to the driver's line of sight. (Japanese Unexamined Patent Application Publication No. 2000-212543) has been proposed.
[0004]
[Problems to be solved by the invention]
The route instruction by voice as described above is an effective method of transmitting the traveling direction and the like to the occupant. However, in the conventional route guidance device, it was not possible to determine whether or not the occupant correctly recognized the voice route instruction. In view of such a situation, the present inventors have tried to apply the technology for detecting the driver's visual recognition behavior described above to a route guidance device.
[0005]
The present invention has been made in order to solve the above-described problem, and based on a visual recognition behavior of an occupant, a route guidance device, a route guidance method, which can determine whether or not the occupant has correctly recognized a voice route instruction. It is another object of the present invention to provide a route guidance program.
[0006]
[Means for Solving the Problems]
According to the present invention, there is provided a route guidance device having a function of guiding a vehicle to a destination, comprising: a route instructing unit configured to instruct an occupant of the vehicle by voice, and detecting a visual recognition behavior of the occupant of the vehicle. Route guidance, comprising: a visual recognition action detecting means for determining whether or not the occupant has correctly recognized the route instruction based on a detection result of the visual recognition action detecting means. An apparatus is provided.
[0007]
According to the present invention having such a configuration, since the route guidance device can determine whether or not the occupant has correctly recognized the route instruction by voice, for example, subsequent route guidance can be appropriately performed.
[0008]
According to a preferred aspect of the present invention, the visual recognition behavior determining means detects the visual recognition behavior of the occupant based on the sight line or head movement of the occupant.
[0009]
According to another preferred aspect of the present invention, when the determination unit determines that the occupant does not correctly recognize the route instruction, the route instruction unit performs the route instruction again. According to such a configuration, appropriate route guidance according to the degree of understanding of the occupant is performed.
[0010]
According to another preferred aspect of the present invention, when the determination unit determines that the occupant does not correctly recognize the route instruction, the route instruction unit performs a different route instruction from a previous route instruction. According to such a configuration, appropriate route guidance according to the understanding of the occupant is performed.
[0011]
According to another preferred aspect of the present invention, the route instruction unit suspends the route instruction when the determination unit determines that the occupant has correctly recognized the route instruction. That is, even in the middle of a phrase, subsequent phrases are not generated.
[0012]
According to such a configuration, the route instruction is interrupted when the route instruction is correctly recognized, so that even when the content of the route instruction is detailed, the occupant does not feel uncomfortable.
[0013]
According to still another preferred aspect of the present invention, when the determination means determines that the occupant has correctly recognized the route instruction, the route instruction means switches the display screen to a detailed display. According to such a configuration, appropriate route guidance according to the degree of understanding of the occupant is performed.
[0014]
According to still another preferred aspect of the present invention, when the occupant's line of sight is not stable, the determining means determines that the occupant does not correctly recognize the route instruction.
[0015]
According to still another preferred aspect of the present invention, when the occupant's line of sight does not respond to the route instruction, the determining means determines that the occupant does not correctly recognize the route instruction.
[0016]
According to another aspect of the present invention, there is provided a route guiding method for guiding a vehicle to a destination, wherein a step of instructing an occupant of the vehicle by voice and a step of detecting a visual recognition action of the occupant of the vehicle are provided. And a step of determining whether or not the occupant has correctly recognized the route instruction based on a detection result of the visual recognition behavior detecting means.
[0017]
According to another aspect of the present invention, there is provided a route guidance program for guiding a vehicle to a destination, instructing an occupant of the vehicle by voice, detecting a visual recognition action of the occupant of the vehicle, A route guidance program is provided, wherein the computer is operated so as to determine whether or not the occupant has correctly recognized the route instruction based on the detection result of the viewing behavior detection means.
[0018]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a basic configuration diagram showing one embodiment of the route guidance device of the present invention.
[0019]
In FIG. 1, reference numeral 1 indicates a vehicle route guidance device (navigation device). An information center 2 is provided outside the vehicle. The information center 2 includes a host computer 4, a database 6 for map information and the like for storing map information and the like, and a various content database 8 for storing various contents. Have.
[0020]
The route guidance device 1 is connectable to the Internet 12 via a communication station 10 installed in each region, and is configured to be able to receive various information including map information from the information center 2.
[0021]
Since the route guidance device 1 includes a DVD-ROM storing map information for route guidance, it is possible to provide information on route guidance even when map information is not received from the information center 2. When the map information is received from the information center 2, more accurate route guidance and the like can be performed based on the latest map information.
[0022]
The route guidance apparatus 1 communicates various information such as map information and the like from the information center 2 to the Internet 12 via the Internet 12 and the CPU 14 for performing route guidance (route guidance) of a vehicle to a destination based on input data and occupant operation. A transmission / reception device 16 for receiving via the station 10 and transmitting information from the vehicle side to the information center 2 is provided. The transmission / reception device 16 is, for example, a car phone or a mobile phone.
[0023]
The route guidance device 1 further includes an HDD storage device 18 for storing map information received from the information center 2, a display 20 for displaying various information such as map information, and a vehicle separately from the map information from the information center 2. A DVD-ROM 22 for storing map information prepared independently by the user, an operation switch 24 for the occupant to set a destination or request map information or the like to the information center 2, and a switch for when information cannot be received from the information center 2. An alarm device 26 that warns the user is provided.
[0024]
The route guidance device 1 includes a GPS receiver 28 that detects the current position of the vehicle, a vehicle speed sensor 30, and a gyro sensor 32. The GPS receiver 28 receives a radio wave from a satellite to detect the current position of the vehicle, the vehicle speed sensor 30 detects the speed of the vehicle to obtain the moving distance, and the gyro sensor 32 detects the moving direction of the vehicle. The route guidance device 1 is configured so that the current position and direction of the vehicle can be accurately calculated from the detection results of the sensors 28, 30, and 32.
[0025]
In addition, the route guidance device 1 includes a VICS receiver 34 for obtaining congestion information and the like from the information center 2 or another traffic information center (not shown).
[0026]
The route guidance device 1 according to the present embodiment additionally displays a route guidance display on a map displayed on a display, notifies the occupant of the traveling direction and the like by voice guidance, and performs route guidance. Furthermore, the movement of the line of sight of the occupant (driver) responding to the route guidance by voice is detected, and from this detection result, it is determined whether or not the driver has correctly recognized the route guidance by voice. Then, the contents of the next route guidance to be performed subsequently are determined.
[0027]
In order to perform such gaze guidance, the route guidance device 1 includes an eye camera 36 and a viewing behavior determination device 38.
[0028]
The eye camera 36 is mounted at an upper position in the cabin, and is configured to be able to detect the movement of the driver's eyes (line of sight) in response to voice guidance by photographing the driver's eyes. . That is, in the present embodiment, based on the detection result of the eye camera 36, at least whether the driver's line of sight has moved from the front direction, for example, to the right front (or left front) or to the display in response to the voice guidance. Or, it is configured to obtain information such as whether it is not moving or is moving around.
[0029]
The viewing behavior determination device 38 includes a computer, and estimates how the driver has recognized the voice guidance from information on the movement of the driver's line of sight in response to the voice guidance obtained from the eye camera 36, and further includes: It is configured to determine the contents of the subsequent route guidance according to the estimated recognition state.
[0030]
For example, in the route guidance apparatus according to the present embodiment, the eye camera 36 detects the driver's line of sight when the voice guidance “Please turn right at the next intersection” is given a predetermined distance before the intersection to be turned right. I do. Based on this detection result, the visual recognition behavior determination device 38 determines whether or not the driver has recognized the “next intersection”.
When it is detected from the detection result of the eye camera 36 that the driver has turned his / her gaze to the front right, it is estimated that the driver has correctly recognized the voice guidance, and the display on the display is changed to an intersection where a right turn should be made. For example, the display is changed to an enlarged display. At this time, if it is detected that the driver turns his / her gaze right forward while the voice guidance is being performed, that is, when the vehicle has proceeded to the “turn right at the next intersection”, the voice guidance is interrupted, that is, the subsequent phrase "Please do" is not generated, and processing such as immediately changing the display on the display to an enlarged display of an intersection to be turned right is performed.
[0031]
On the other hand, after the voice guidance, if the driver's line of sight turns to the display mounted on the upper part of the center console, moves to the left or right, or does not move at all, the driver recognizes the voice guidance correctly. It is presumed that there is no guidance, and the voice guidance is started again. The second voice guidance may be more detailed than the previous voice guidance, for example, "Please turn right at the intersection where the fire station is in the next corner." At this time, the driver correctly recognized the voice guidance when it was detected that the driver turned his / her gaze to the right front in the middle of the voice guidance, that is, when the vehicle advanced to the “fire station at the next corner”. It is estimated that the voice guidance is interrupted, that is, the subsequent phrase "Please turn right at an intersection" is not generated, and the display on the display is immediately changed to an enlarged display of the intersection to be turned right, etc. Is performed.
[0032]
Next, the visual recognition behavior determination processing executed when the voice guidance is performed will be described with reference to the flowchart of FIG. This process is executed in parallel with the voice guidance. The voice guidance is "Please turn right at the next intersection."
[0033]
First, when the process starts, in step S1, it is determined whether or not the driver's line of sight has turned in the direction (guidance direction) instructed by the voice guidance. The driver's line of sight is detected by the eye camera 36 as described above. If NO in step S1, it is determined in step S2 whether or not the driver's line of sight has turned to the display direction.
[0034]
When YES is determined in Step S2, it is estimated that the driver cannot visually recognize the guidance target (the intersection to be turned right) by the voice guidance, and cannot visually recognize the guidance target such as trying to confirm on the display. Therefore, the process proceeds to step S3, and the voice guidance is executed again. The voice guidance at this time may be more detailed than the previous voice guidance, for example, "Please turn right at the next intersection with a fire station at the corner."
[0035]
If NO in step S2, the process proceeds to step S4, and it is determined whether or not the driver's line of sight has moved as a result of the voice guidance. If NO in step S4, it is estimated that the driver has overlooked the voice guidance, for example, so the process proceeds to step S3, and the voice guidance is executed again.
[0036]
When YES is determined in the step S4, the process proceeds to a step S5, and it is determined whether or not the driver's line of sight is unstable such as moving right and left. When YES is determined in step S5, it is estimated that the guidance target cannot be visually recognized, for example, the driver is unable to visually recognize the target (the intersection to be turned right) indicated by the voice guide, and is "seeing away". Therefore, the process proceeds to step S3, and the voice guidance is executed again. The voice guidance at this time may be more detailed than the previous voice guidance, for example, "Please turn right at the next intersection with a fire station at the corner."
[0037]
If NO in step S5 or YES in step S1, it is presumed that the driver has correctly viewed the target (for example, the intersection to be turned right) indicated by the voice guide, so the process proceeds to step S6 and proceeds to step S6. Discontinue further voice guidance on. That is, even during the guidance, the rest of the guidance is not executed. When the process proceeds to step S6 after completing the "turn right at the next intersection", the subsequent phrase "please" is omitted. At the same time, the display on the display is switched to a detailed display such as an enlarged display of an intersection to be turned. Originally, this enlarged display is switched and displayed when approaching the intersection to a predetermined distance, but from the driver's visual recognition behavior, the driver has recognized the intersection in the field of view (actual scenery). Therefore, even if the vehicle is located farther than the predetermined distance from the intersection, the display is switched to the detailed display and the information is provided to the driver as soon as possible. Similar processing is performed when the process proceeds to step S6 during the voice guidance again.
[0038]
According to such a configuration, appropriate route guidance can be executed according to the degree of recognition of the driver. Further, since the guidance is stopped when it is estimated that the driver has correctly recognized the voice guidance, the driver is less likely to feel bothered even if the voice guidance is detailed. For this reason, the voice guidance can be set as a setting for explaining the information in detail.
[0039]
The present invention is not limited to the above embodiments, and various changes or modifications can be made within the scope of technical matters described in the claims.
[0040]
In the above-described embodiment, the eye camera detects the movement of the driver's line of sight to detect the driver's visual recognition behavior. However, the normal camera captures the driver's head (face), and the imaging result is obtained. Therefore, a configuration in which the driver's visual recognition behavior is detected may be used.
[0041]
Further, a configuration in which the screen switching in step S6 is not performed or a configuration in which the entire process of step S6 is not performed may be employed.
[0042]
【The invention's effect】
As described above, according to the present invention, there is provided a route guidance device, a route guidance method, and a route guidance program that can determine whether or not a passenger correctly recognizes a voice route instruction based on a visual recognition behavior of a passenger. Is done.
[Brief description of the drawings]
FIG. 1 is a basic configuration diagram showing one embodiment of a route guidance device of the present invention.
FIG. 2 is a flowchart illustrating the contents of a viewing behavior determination process executed by the route guidance device according to the embodiment of the present invention.
[Explanation of symbols]
1: Route guidance device (navigation device)
18: HDD storage device 22: DVD-ROM
36: Eye camera 38: Viewing behavior determination device

Claims (11)

A route guidance device having a function of guiding a vehicle to a destination,
Route instructing means for instructing an occupant of the vehicle by voice,
A viewing behavior detecting means for detecting a viewing behavior of an occupant of the vehicle,
Determining means for determining whether or not the occupant has correctly recognized the route instruction based on a detection result of the visual recognition action detecting means;
A route guidance device comprising: The visual recognition behavior determining means detects the visual recognition behavior of the occupant based on the movement of the occupant's line of sight.
The route guidance device according to claim 1. The visual recognition behavior determining means detects the visual recognition behavior of the occupant based on the movement of the occupant's head,
The route guidance device according to claim 1. The route instruction means, when the determination means determines that the occupant does not correctly recognize the route instruction, performs the route instruction again,
The route guidance device according to claim 1. The route instructing means, when the determining means determines that the occupant does not correctly recognize the route instruction, performs a different route instruction from the previous route instruction,
The route guidance device according to claim 1. The route instruction means suspends the route instruction when the determination means determines that the occupant has correctly recognized the route instruction,
The route guidance device according to claim 4. The route instruction means switches the display on the display screen to a detailed display when the determination means determines that the occupant has correctly recognized the route instruction.
The route guidance device according to claim 1. The determining means determines that the occupant does not correctly recognize the route instruction when the occupant's line of sight is not stable,
The route guidance device according to any one of claims 4 to 7. When the occupant's line of sight does not respond to the route instruction, the determining unit determines that the occupant does not correctly recognize the route instruction.
The route guidance device according to any one of claims 4 to 8. A route guidance method for guiding a vehicle to a destination,
Performing a voice route instruction to the occupant of the vehicle;
Detecting the visual recognition behavior of the occupant of the vehicle;
A step of determining whether or not the occupant has correctly recognized the route instruction, based on a detection result of the viewing behavior detection means;
A route guidance method, comprising: A route guidance program for guiding a vehicle to a destination,
Instruct the occupant of the vehicle a voice route instruction,
Detecting the visual recognition behavior of the occupant of the vehicle,
Based on the detection result of the viewing behavior detection means, operating a computer to determine whether the occupant has correctly recognized the route instruction,
A route guidance program characterized by the following.

Images