JP5622820B2 - Gaze guidance system - Google Patents

Description

  The present invention relates to a line-of-sight guidance system for guiding the line of sight of a driver of a vehicle such as an automobile.

Currently, in a vehicle such as an automobile, a car navigation system that indicates a route to a destination to a driver is widely used. In general, a car navigation system displays route guidance on a display installed on a dashboard.
In Patent Document 1, a guide route is displayed as a cable image above an actual road visually recognized from a driver's seat.
In Patent Document 2, in a three-dimensional display, a mark corresponding to a route is drawn in the air above the road corresponding to the route.
In patent document 3, a guidance figure is changed according to the distance of a guidance point and the own vehicle.

Special table 2008-501956 Japanese Patent Laid-Open No. 2004-117294 JP-A-9-34352

However, even if the various car navigation systems described above are used, the burden on the driver is large.
For example, in a car navigation system, the guidance route is not displayed in association with an actual road that is generally viewed from the driver's seat, and is displayed separately from the actual road. In this case, the driver recognizes the route by the route displayed by the route display, associates the recognized route with the actual road, and determines the road to be traveled in the actual road based on the correspondence. It is necessary to identify and carry out driving operations. After the route is displayed, it takes time to specify the road to travel and to perform the driving operation.
In addition, there are pedestrians, bicycles, other vehicles, fallen objects, and the like on and around the traveling road of the vehicle. The driver needs to understand and determine the route based on the display of the car navigation system, pay attention to these extraneous objects that need to be alerted, and further avoid the vehicle while operating the vehicle. In particular, it is desirable to be able to alert a vehicle exterior on the side of the vehicle because it is outside the field of view in front of the vehicle.

  Thus, in vehicles such as automobiles, it is required to reduce the burden on the driver.

  In order to reduce the burden on the driver, the present invention provides a line-of-sight guidance system with respect to the traveling direction and surrounding vehicles.

  The line-of-sight guidance system according to the present invention outputs, in front of the driver of the vehicle, a video display unit that displays an image superimposed on the windshield, and virtual line video information for guiding the line of sight to the video display unit. A processing unit, and the processing unit extends from the upper side of the driver along the course of the vehicle visually recognized in the windshield, and on the path where the tip of the virtual line is visually recognized in the windshield. Video information that displays a warning display for an outside vehicle outside the display range of the video display unit in front of the vehicle is output in conjunction with a virtual line.

  Preferably, in the display range of the video display unit, the processing unit displays a warning display for a vehicle outside the display range of the video display unit in front of the vehicle as a line connecting the vehicle outside and the virtual line. Should be output.

  Preferably, the processing unit may output video information that branches and displays a warning display so as to extend from the virtual line toward the outside of the vehicle while the virtual line is displayed.

  Preferably, the processing unit may output video information for switching the display of the virtual line to the alert display.

  Preferably, a line-of-sight detection unit that detects the driver's line of sight is provided, and the processing unit changes the display of the alert display according to information from the line-of-sight detection unit.

  Preferably, a road surface in front of the vehicle is captured based on an image captured by the camera that captures the image within the field of view of the driver in front of the vehicle, a side camera that captures the image outside the field of view of the driver in front of the vehicle. A road surface recognition unit for recognizing a driver ahead of the vehicle based on an image captured by the side camera while outputting video information in which the tip of the virtual line overlaps the recognized road surface. It is good to recognize the vehicle outside thing outside the visual field range, and to output video information for displaying a warning display about the vehicle outside object.

  Preferably, the camera is a stereo camera.

Preferably, a vehicle speed detection unit that detects the vehicle speed of the vehicle is provided, the video display unit is a video projection unit that projects an image on the windshield, and the processing unit is a virtual line viewed from the driver by the video projection unit. It is good to output the video information which changes the display of a virtual line according to the vehicle speed from a vehicle speed detection part so that it may reach from the upper edge of a windshield to a road surface.

According to the line-of-sight guidance system of the present invention, a warning display about a warning target around the vehicle is displayed in a superimposed manner on the windshield in front of the driver. Moreover, the warning display extends from the upper side of the driver along the course of the vehicle that is visible in the windshield, and is linked to the virtual line from the top of the virtual line to the road surface on the course that is visible in the windshield. Is displayed.
The driver's line of sight is guided to a warning object outside the visual field range and outside the display range of the video display unit by a warning display displayed in conjunction with the virtual line.
The driver can directly look at the alert object with a naturally guided line of sight. The driver does not associate the display with the alert target object, or specifies the alert target object related to the display based on the association, and can display the alert target object outside the display range of the video display unit. Visible immediately.
In this invention, a driver | operator's eyes | visual_axis is induced | guided | derived to the alerting target object outside the display range of a video display part by a virtual line or an alerting display, and a driver | operator's burden can be reduced.

It is a figure showing the whole line-of-sight guidance system concerning a 1st embodiment of the present invention. 1 is a block configuration diagram of a line-of-sight guidance system according to a first embodiment of the present invention. It is a whole flowchart of the gaze guidance system concerning a 1st embodiment of the present invention. It is a partial flowchart of the gaze guidance display processing of the gaze guidance system concerning a 1st embodiment of the present invention. It is a flowchart which concerns on the alert display of the gaze guidance display process of the gaze guidance system which concerns on 1st Embodiment of this invention. It is a figure of the operation state containing an example of the display on a windshield in the gaze guidance system which concerns on 1st Embodiment of this invention. It is a figure of the operation state containing an example of the display on a windshield in the gaze guidance system which concerns on 1st Embodiment of this invention. It is a flowchart which concerns on the alert display of the gaze guidance display process of the gaze guidance system which concerns on 2nd Embodiment of this invention. It is a figure of the operation state containing an example of the display on a windshield in the gaze guidance system which concerns on 2nd Embodiment of this invention. It is a flowchart which concerns on the alert display of the gaze guidance display process of the gaze guidance system which concerns on 3rd Embodiment of this invention. It is a figure of the operation state containing an example of the display on a windshield in the gaze guidance system which concerns on 3rd Embodiment of this invention. It is a partial flowchart of the gaze guidance display process of the gaze guidance system concerning a 4th embodiment of the present invention. It is a figure of the operation state containing an example of the display on a windshield in the gaze guidance system which concerns on 4th Embodiment of this invention. It is a figure of the operation state containing an example of the display on a windshield in the gaze guidance system which concerns on 4th Embodiment of this invention. It is a figure of the operation state containing an example of the display on a windshield in the gaze guidance system which concerns on 4th Embodiment of this invention. It is a figure of the operation state containing an example of the display on a windshield in the gaze guidance system which concerns on 4th Embodiment of this invention. It is a figure of the operation state containing an example of the display on a windshield in the gaze guidance system which concerns on 4th Embodiment of this invention.

  Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

[First Embodiment]
1 to 7 show a first embodiment of the present invention. The line-of-sight guidance system of the present invention will be described with reference to FIG.

  FIG. 1 is a diagram illustrating an entire line-of-sight guidance system according to the first embodiment of the present invention. The line-of-sight guidance system 1 includes a map information database 2, a GPS (Global Positioning System) antenna 3, a windshield 6 installed in front of the driver, a video display unit (video projection unit 7), and a map information database 2 Is provided with a processing unit 10 for outputting desired route information from the map information obtained from the GPS and the GPS information acquired by the GPS antenna 3. The line-of-sight guidance system 1 is further equipped with an antenna 4 for communication with intelligent road traffic systems such as VICS (Vehicle Information and Communication System) and ETC (Electronic Toll Collection System), and is used to acquire traffic information and pay on toll roads. Do.

  A vehicle speed sensor 5 is provided on the vehicle rear wheel, and detected vehicle speed information is input to the processing unit 10. A stereo camera 8 composed of two cameras is provided in the vehicle interior and images the front outside the vehicle. The stereo camera 8 can measure the distance to the object in front of the vehicle and the road surface by the parallax. Further, in the passenger compartment, a line-of-sight detection unit 9 for detecting the driver's line of sight, an operation unit 11 for the driver to set a desired destination, a microphone 15 for setting a destination by voice, and brightness are detected. An illuminance sensor 14 and the like are provided.

  Information from the steering input detection unit 12 that detects the steering of the driver and the braking input detection unit 13 that detects the braking of the driver is also input to the processing unit 10. Furthermore, a side camera 19 (see FIG. 2) is provided for detecting and capturing an image outside the driver's visual field range and outside the display range of the video display unit.

  Next, the components connected to the processing unit 10 will be described with the processing unit 10 as a center. FIG. 2 is a block configuration diagram of the line-of-sight guidance system according to the first embodiment of the present invention. The processing unit 10 includes a map information database 2, a GPS antenna 3, an antenna 4, a vehicle speed sensor 5, a video projection unit 7, an image processing unit 17, a stereo camera 8 and a side camera 19, a line-of-sight detection unit 9, an operation unit 11, The steering input detection unit 12, the braking input detection unit 13, the illuminance sensor 14, and the sound analysis unit 16 are connected to the microphone 15.

  The processing unit 10 receives information from the vehicle speed sensor 5, the line-of-sight detection unit 9, and the like, and performs processing for changing the display shape of the virtual line L displayed on the windshield 6. The virtual line L of the present embodiment functions as a line-of-sight guidance line that reaches the line-of-sight guidance object or a course guidance line that indicates the traveling direction of the vehicle. Also, information from the operation unit 11 provided in the vehicle, information from the steering input detection unit 12 that detects the steering operation by the driver, information from the braking input detection unit 13 that detects the brake operation of the driver, and an illuminance sensor 14 also receives illuminance information in the vicinity of the windshield 6 and information from the microphone 15 (information analyzed by the sound analysis unit 16).

  Further, the processing unit 10 displays the virtual line L according to the information from the steering input detection unit 12 that detects the steering operation by the driver and the information from the braking input detection unit 13 that detects the brake operation of the driver. Etc. Furthermore, the processing unit 10 changes the density, brightness, and the like so that the virtual line L is easy for the driver to see from the illuminance information near the windshield 6 by the illuminance sensor 14.

  Next, details will be described with reference to a flowchart of the line-of-sight guidance system and a diagram of an operation state of the line-of-sight guidance system including a state when the driver looks from the driver's seat. FIG. 3 is an overall flowchart of the line-of-sight guidance system according to the first embodiment of the present invention.

  The driver designates a destination by operating the operation unit 11 provided in the vehicle. In addition, by saying the destination to the microphone 15 that detects the driver's voice, the voice analysis unit 16 can analyze the voice and specify the destination (step ST10).

  The processing unit 10 performs route processing according to the designated destination (step ST11). In the route processing, the processing unit 10 acquires the vehicle position and the vehicle direction from the map information in the map information database 2 and the GPS information acquired by the GPS antenna 3, and calculates a desired route to the destination. Map information necessary for the route and route guidance is stored in the memory 20. When it is determined that the vehicle position based on the GPS information is not on the route during traveling or the like, the route is calculated at appropriate times and the information in the memory 20 is rewritten.

  The video projection unit 7 displays the route to the destination stored in the memory 20 of the processing unit 10 and the virtual line L processed based on the map information, road information, and the like on the windshield 6 (step ST12). In the line-of-sight guidance display process, the processing unit 10 also uses information on the road surface received from the stereo camera 8 and information on the distance to the road surface and an object outside the vehicle.

  The video imaged by the stereo camera 8 is processed by the image processing unit 17, and the road surface is recognized by the road surface recognition unit 18. At the same time, the image processing unit 17 analyzes the relative speed and distance with the object within the range imaged by the stereo camera 8. Thereby, the processing unit 10 processes information to be displayed using not only the route and map information but also the distance and road surface information. The processing unit 10 changes the display shape of the virtual line L according to the speed of the vehicle and sends information to be displayed on the windshield 6 to the video projection unit 7.

  In the first embodiment, the image projection unit 7 is used as the image display unit. However, a transmissive organic EL sheet may be provided on the windshield and displayed directly on the sheet. In this case, the processing unit 10 outputs video information to the organic EL sheet.

  Next, typical visual guidance display processing of the visual guidance system according to the present invention will be described with reference to the flowchart of FIG. FIG. 4 is a flowchart of the gaze guidance display process of the gaze guidance system according to the first embodiment of the present invention.

  In the line-of-sight guidance display process of step ST12, the road surface recognition unit 18 recognizes the road surface from the image captured by the stereo camera 8 and processed by the image processing unit 17, and sends this information to the processing unit 10. Thereby, a road surface is recognized (step ST13).

  Next, the processing unit 10 displays video information for displaying the route to the destination stored in the memory 20 and the tip of the virtual line L processed based on the map information on the recognized road surface. Is output (step ST14). When viewed from the driver, the tip of the virtual line L appears to be grounded on the road surface.

  Thereby, on the windshield provided in front of the driver, the virtual line L is displayed so as to overlap the actual scenery or road, and the burden on the driver can be reduced. Further, by displaying on the glass, it is possible to guide the line of sight even when there is no voice or sound assistance instruction. This is based on the human habit of looking for an edge when there is a line. Therefore, it is possible to guide the traveling direction naturally from the viewpoint of the traveling state, and it is possible to guide to the line of sight suitable for the traveling environment without being conscious of the driver. In addition, since it displays with the line, the ratio which hides a road environment is small, and a course guidance line and a road environment can be visually observed together.

  Next, the line-of-sight guidance display processing of the line-of-sight guidance system will be described in detail with reference to FIGS. FIG. 5 is a flowchart according to the alert display LA of the visual guidance display process of the visual guidance system according to the first embodiment of the present invention. The alert display LA is processed as part of the line-of-sight guidance display. FIGS. 6 and 7 are diagrams showing an operation state including an example of display on the windshield in the line-of-sight guidance system according to the first embodiment of the present invention. In the figure of the operating state, there is a driver A on the front side, a windshield 6 and an indoor mirror 6M in front of the driver A, and the driver A sees an actual image outside the vehicle with the windshield 6 in between. ing.

  As shown in FIG. 6, when a vehicle outside the display range of the video display unit is not recognized, or even if a vehicle outside is recognized, the vehicle is not a vehicle outside enough to call attention and no alert is displayed. In addition, the virtual line L is displayed on the windshield in front of the driver A so as to overlap the road surface in front of the vehicle.

  The processing unit 10 recognizes an object outside the vehicle from the image captured by the side camera 19 and processed by the image processing unit 17 (step ST15). If no external object is recognized (NO in step ST15), step ST15 is repeated. When a vehicle outside object is recognized (YES in step ST15), it is determined whether or not it is necessary to call attention to the vehicle outside object (step ST16).

  If it is determined that it is not necessary to call attention to the recognized vehicle exterior (NO in step ST16), recognition of another vehicle exterior in the image captured by the side camera 19 and processed by the image processing unit 17 is performed. Perform (again, step ST15, step ST16).

  If it is determined that attention is required for the recognized vehicle exterior (YES in step ST16), a warning display LA is performed (step ST17). The processing unit 10 outputs video information that displays a warning display LA about an outside object in conjunction with the virtual line L, in addition to the road surface on the path where the tip of the virtual line L is visually recognized in the windshield. To do. Specifically, the processing unit 10 outputs video information for performing the alert display LA as a line connecting the vehicle exterior and the virtual line L. At this time, when an external object can be recognized by the side glass when viewed from the driver A, the alert display LA can be performed on the side glass.

  As shown in FIG. 7, a warning display LA is displayed on the windshield 6 viewed by the driver A while the virtual line L is displayed. In FIG. 7, the bicycle B approaching the road on which the vehicle is traveling is recognized as an external object to be alerted, and the alert display LA is performed as a line connecting the bicycle B and the virtual line L. Further, the virtual line L is branched and is displayed so as to extend from the virtual line L toward the bicycle B while the virtual line L is displayed. This is for the vehicle information (bicycle B) recognized and processed by the image processing unit 17 by the processing unit 10 to send video information of a line (notification line) extending from the virtual line L to the video projection unit 7. Is displayed.

  Next, it is determined whether or not to end the displayed alert display LA (step ST20). When the alert display LA does not end (NO in step ST20), the alert is continuously displayed. When the alert display LA ends (YES in step ST20), the line-of-sight guidance display is performed.

[Second Embodiment]
8 and 9 show a second embodiment of the present invention. The line-of-sight guidance system according to the present invention will be described with reference to FIGS.
Next, the line-of-sight guidance display processing of the line-of-sight guidance system will be described in detail with reference to FIGS. 8 and 9. FIG. 8 is a flowchart according to the alert display LA of the line-of-sight guidance display process of the line-of-sight guidance system according to the second embodiment of the present invention. FIG. 9 is a diagram of an operation state including an example of display on the windshield in the line-of-sight guidance system according to the second embodiment of the present invention.

  When a vehicle outside the display range of the video display unit is not recognized, or even if a vehicle outside is recognized, the vehicle is not a vehicle outside enough to alert, and the alert is not displayed. Similar to the embodiment, as shown in FIG. 6, the virtual line L is displayed on the windshield in front of the driver A so as to overlap the road surface in front of the vehicle.

  The processing unit 10 recognizes an object outside the vehicle from the image captured by the side camera 19 and processed by the image processing unit 17 (step ST15). If no external object is recognized (NO in step ST15), step ST15 is repeated. When a vehicle outside object is recognized (YES in step ST15), it is determined whether or not it is necessary to call attention to the vehicle outside object (step ST16).

  If it is determined that it is not necessary to call attention to the recognized vehicle exterior (NO in step ST16), recognition of another vehicle exterior in the image captured by the side camera 19 and processed by the image processing unit 17 is performed. Perform (again, step ST15, step ST16).

  If it is determined that attention is required for the recognized vehicle exterior (YES in step ST16), switching to the alert display LA is performed (step ST18). As shown in FIG. 9, the display of the virtual line L is erased and switched to the alert display LA. In FIG. 9, the bicycle B approaching the road on which the vehicle is traveling is recognized as an external object to be alerted, and the alert display LA is performed on the bicycle B. This is displayed by sending video information extending toward the bicycle B to the video projection unit 7 with respect to the vehicle exterior (bicycle B) recognized by the processing unit 10 processed by the image processing unit 17. At this time, when an external object can be recognized by the side glass when viewed from the driver A, the alert display LA can be performed on the side glass.

  Next, it is determined whether or not to end the displayed alert display LA (step ST20). When the alert display LA does not end (NO in step ST20), the alert is continuously displayed. When the alert display LA ends (YES in step ST20), the line-of-sight guidance display is performed.

[Third Embodiment]
10 and 11 show a third embodiment of the present invention. The line-of-sight guidance system according to the present invention will be described with reference to FIGS.
Next, the line-of-sight guidance display processing of the line-of-sight guidance system will be described in detail with reference to FIGS. 10 and 11. FIG. 10 is a flowchart according to the alert display LA of the line-of-sight guidance display process of the line-of-sight guidance system according to the third embodiment of the present invention. FIG. 11 is a diagram of an operation state including an example of display on the windshield in the line-of-sight guidance system according to the third embodiment of the present invention.

  When a vehicle outside the display range of the video display unit is not recognized, or even if a vehicle outside is recognized, the vehicle is not a vehicle outside enough to alert, and the alert is not displayed. Similar to the embodiment, as shown in FIG. 6, the virtual line L is displayed on the windshield in front of the driver A so as to overlap the road surface in front of the vehicle.

  The processing unit 10 recognizes an object outside the vehicle from the image captured by the side camera 19 and processed by the image processing unit 17 (step ST15). If no external object is recognized (NO in step ST15), step ST15 is repeated. When a vehicle outside object is recognized (YES in step ST15), it is determined whether or not it is necessary to call attention to the vehicle outside object (step ST16).

  If it is determined that it is not necessary to call attention to the recognized vehicle exterior (NO in step ST16), recognition of another vehicle exterior in the image captured by the side camera 19 and processed by the image processing unit 17 is performed. Perform (again, step ST15, step ST16).

  If it is determined that attention is required for the recognized vehicle exterior (YES in step ST16), a warning display LA is performed (step ST17). As in the first embodiment of the present invention, as shown in FIG. 7, the alert display LA is displayed while the virtual line L is displayed. In FIG. 7, the bicycle B approaching the road on which the vehicle is traveling is recognized as an external object to be alerted, and the alert display LA is performed as a line connecting the bicycle B and the virtual line L. Further, the virtual line L is branched and is displayed so as to extend from the virtual line L to the bicycle B while the virtual line L is displayed. This is displayed by sending video information branched from the virtual line L to the video projection unit 7 toward the vehicle exterior (bicycle B) recognized by the processing unit 10 processed by the image processing unit 17.

  Next, the line-of-sight detection unit 9 detects the line of sight of the driver A and sends the line-of-sight detection information to the processing unit 10. The processing unit 10 determines from the line-of-sight detection information and the image information from the image processing unit 17 whether the driver A's line of sight has recognized an object outside the vehicle (bicycle B) (step ST19). If driver A's line of sight does not recognize an object outside the vehicle (bicycle B) (NO in step ST19), the alert display LA is continued (step ST17). At this time, the alert display LA may be further emphasized.

  When driver A's line of sight recognizes an external vehicle (bicycle B) (YES in step ST19), the alert display LA is changed or erased (step ST40). In FIG. 11, it is shown that the driver A's line of sight recognizes an object outside the vehicle (bicycle B), and then the alert display LA is erased and the virtual line L is displayed.

  The line-of-sight detection can be performed with an infrared camera that captures the reflected light from the cornea. In addition, the eye and face image sample when the subject is looking at the direction determined by the camera is registered in the measurement system in advance, and the angle between the face direction and the eye direction is measured, The line-of-sight direction can also be specified by calculating the sum of the angles.

  At this time, the orientation of the face detects the position of the whole human head and the facial organs such as eyes and nose from the image, and the orientation of the eye detects the entire area of the eye and the position of the black eye from the image, By applying these positional relationships to the eyeball model, an angle from the front direction of the face is measured.

  In the above embodiment, examples of the shape of the virtual line and the alert display LA have been described. It can be changed in real time according to the information on the line of sight. Moreover, you may make it change the shape of only the edge which the driver | operator is gazing, a color, etc. according to information.

[Fourth Embodiment]
12 to 17 show a fourth embodiment of the present invention. The line-of-sight guidance system of the present invention will be described with reference to FIGS.
Next, the line-of-sight guidance display processing of the line-of-sight guidance system will be described in detail with reference to FIGS. FIG. 12 is a flowchart of the gaze guidance display process of the gaze guidance system according to the fourth embodiment of the present invention. 13 to 17 are diagrams showing an operation state including an example of display on the windshield in the line-of-sight guidance system according to the fourth embodiment of the present invention. In the figure of the operating state, there is a driver A on the front side, a windshield 6 and an indoor mirror 6M in front of the driver A, and the driver A sees an actual image outside the vehicle with the windshield 6 in between. ing.

  The road surface recognition unit 18 recognizes the road surface from the image captured by the stereo camera 8 and processed by the image processing unit 17, and sends this information to the processing unit 10. Thereby, the road surface is recognized (step ST21). For example, whether there is a vehicle within 50 m ahead of the vehicle is detected from the image captured by the stereo camera 8 and processed by the image processing unit 17 (step ST22). The image processing unit 17 can detect a moving object, whether or not the object is a car, a distance / speed to the object, and the like from the image captured by the stereo camera 8 by processing.

  Next, the processing unit 10 refers to the route information and confirms whether there is a guidance for making a right / left turn, for example, within 100 m ahead of the vehicle (step ST23). When there is a vehicle within 50m ahead of the vehicle and there is a guidance to make a right or left turn within 100m ahead of the vehicle, the virtual gaze guidance display overlaps with the vehicle in front and the driver is clearly guided to turn left or right Therefore, the virtual line L is displayed so as not to overlap the preceding vehicle imaged by the stereo camera 8 (step ST24). As shown in FIG. 13, the display is performed so that the vehicle ahead and the virtual line L do not overlap.

  On the other hand, when there is a vehicle within 50 m ahead of the vehicle and there is no guidance for making a right or left turn within 100 m ahead of the vehicle, it is possible to travel so as to follow the vehicle ahead. Since it is necessary to pay attention to sudden braking or the like, display is performed so that the tip of the display of the imaginary line L faces the car ahead of the vehicle (step ST25). For example, as shown in FIG. 14, the virtual line L is displayed so as to go around the roof of the vehicle ahead. When a right turn is made when no vehicle is present ahead, as shown in FIG. 15, the road surface and the virtual line L overlap in front of the driver so that the right turn location can be clearly seen. .

  When it is confirmed from the information from the image processing unit 17 that there is no vehicle within 50 m ahead, the processing unit 10 checks the vehicle speed from the vehicle speed sensor 5 (step ST26). For example, when the vehicle speed is higher than 80 km / h, the virtual line L is displayed toward the road surface 80 m ahead (step ST27). As shown in FIG. 16, when the speed of the vehicle is high, the virtual line L is displayed toward the road surface 80 m ahead in order to guide the line of sight to the far side where the driver should be careful.

  When the vehicle speed is 80 km / h or less and greater than 30 km / h (YES in step ST28), the virtual line L is displayed toward the road surface 50m ahead (step ST29). Further, for example, when the vehicle speed is 30 km / h or less (No in step ST28), the virtual line L is displayed toward the road surface 30m ahead (step ST30). As shown in FIG. 17, when the speed of the vehicle is low, a virtual line L is displayed toward the road surface 30 m ahead in order to guide the line of sight around the front of the vehicle that the driver should be aware of.

  As described above, the processing unit 10 causes the video projection unit to perform virtual processing according to the vehicle speed from the vehicle speed sensor 5 so that the virtual line L viewed from the driver A extends from the upper edge of the windshield 6 to the road surface. By outputting the video information for changing the display of the line L, natural line-of-sight guidance can be performed for the driver A, and the burden on the driver can be reduced.

  As described above, not only the display processing based on the line-of-sight detection information, but also the virtual line L and the information about the driving environment by steering, braking, and traction, and the information around the vehicle by the image captured by the stereo camera 8 The display shape of the alert display LA and display / non-display may be determined. As a running environment, for example, when a vehicle is running on an ice burner where tires are slippery, it is safer to make the line of sight far away even if the vehicle speed is not high. Is displayed so that the line of sight is guided to a position farther than usual. Further, in the case of a night lane, by setting the exit of the corner and the entrance of the next corner to the end of the imaginary line L, it is possible to prevent the lane from protruding and the vehicle body from spinning.

<Configuration and Effect of Embodiment>
The line-of-sight guidance system in the present embodiment outputs an image display unit that displays an image superimposed on the windshield in front of the driver of the vehicle and video information of a virtual line for guiding the line of sight to the image display unit. A processing unit, and the processing unit is configured such that a virtual line extends from above the driver along a vehicle path visually recognized in the windshield, and a path in which the tip of the virtual line is visually recognized in the windshield. Video information for displaying a warning display for an outside vehicle outside the display range of the video display unit is output in conjunction with the virtual road, overlapping with the upper road surface.

  With the above configuration, outside the vehicle that needs to be alerted so that the center of the driver's field of view can be visually recognized in the windshield by displaying a warning about the surrounding vehicle outside in conjunction with a virtual line indicating the course It is possible to guide to an object and perform natural line-of-sight guidance, thereby reducing the burden on the driver.

  In the line-of-sight guidance system according to the present embodiment, the processing unit displays a warning display for an external object outside the display range of the video display unit in front of the vehicle within the display range of the video display unit, and connects the external object and the virtual line. The video information to be displayed is output.

  By being configured as described above, the driver's line of sight can be guided along a line connecting the outside object and the virtual line, and natural line-of-sight guidance can be performed, so the burden on the driver can be reduced.

  In the line-of-sight guidance system according to the present embodiment, the processing unit outputs video information that branches and displays a warning display so as to extend from the virtual line toward the outside of the vehicle while the virtual line is displayed.

  With the above-described configuration, the driver's line of sight can be naturally guided from the course of the phantom line to an outside vehicle that requires attention, and the burden of visually recognizing the driver's attention can be reduced.

  In the line-of-sight guidance system according to the present embodiment, the processing unit outputs video information that switches the display of the virtual line to the alert display.

  By comprising as mentioned above, a driver | operator's eyes | visual_axis can be guide | induced appropriately to the external vehicle which needs alerting, and the burden of visually recognizing a driver's alerting thing can be reduced.

  The line-of-sight guidance system in the present embodiment includes line-of-sight detection means for detecting the driver's line of sight, and the processing unit changes the display of the alert display according to information from the line-of-sight detection means.

  By configuring as described above, the display of the alert display can be changed according to the driver's line of sight, which contributes to safe driving.

  The line-of-sight guidance system according to the present embodiment is based on a camera that captures images within the visual field range of the driver ahead of the vehicle, a side camera that captures images outside the visual field range of the driver ahead of the vehicle, and an image captured by the camera. A road surface recognition unit for recognizing the road surface in front, and the processing unit outputs video information in which the tip of the virtual line overlaps the recognized road surface, based on the image captured by the side camera, A vehicle outside object outside the field of view of the driver in front of the vehicle is recognized, and video information for displaying a warning display about the vehicle outside object is output.

  By configuring as described above, the driver's visual field center can be accurately guided to the road surface, and more natural gaze guidance can be performed.

  In the line-of-sight guidance system in the present embodiment, the camera is a stereo camera.

  By configuring as described above, it is possible to more accurately recognize the road surface, the distance to the vehicle ahead, and the like, and display control according to this information becomes possible.

  In the line-of-sight guidance system in the present embodiment, the video display unit is a video projection unit that projects video onto the windshield, and the processing unit is placed on the video projection unit so that the virtual line viewed from the driver is from the upper edge of the windshield. Video information for changing the display of the virtual line according to the vehicle speed from the vehicle speed detection unit is output so as to reach the road surface.

  With the configuration described above, the driver's visual field center can be guided to an appropriate place according to information such as speed, and guidance that is easy to visually recognize according to actual scenery, other vehicle information, and line-of-sight guidance information can be provided.

<Definition etc.>
The video display unit of the present invention refers to a video projection unit that projects a video on a windshield, a transmissive organic EL sheet that performs display using video information from a processing unit, and the like.

  The virtual line L of the present invention is a display and projection of a visible image such as a line or dotted line displayed on a windshield, rear glass, side glass such as a front windshield, and guides the line of sight to the driver. Any display is possible as long as the display is possible.

1 Gaze guidance system 2 Map information database 3 GPS antenna 4 Antenna 5 Vehicle speed sensor (vehicle speed detector)
6 windshield 7 video projection unit 8 stereo camera 9 gaze detection unit 10 processing unit 11 operation unit 12 steering input detection unit 13 braking input detection unit 14 illuminance sensor 15 microphone 16 voice analysis unit 17 image processing unit 18 road surface recognition unit 19 side camera 20 Memory L Virtual line LA Alert display

Claims (8)

In front of the driver of the vehicle, an image display unit that displays an image superimposed on the windshield,
A processing unit that outputs video information of a virtual line for guiding the line of sight to the video display unit,
The processing unit is configured so that the imaginary line extends from above the driver along a course of a vehicle that is visually recognized in the windshield, and a tip of the imaginary line is on a path that is visually recognized in the windshield. Overlapping with the road surface, and in conjunction with the virtual line, outputs video information that displays a warning display about a vehicle outside the display range of the video display unit,
Gaze guidance system characterized by that. The processing unit displays, in the display range of the video display unit, the alert display for an external vehicle outside the display range of the video display unit in front of the vehicle as a line connecting the external vehicle and the virtual line. Output video information,
The line-of-sight guidance system according to claim 1. The processing unit outputs video information that branches and displays the alert display so as to extend from the virtual line toward the outside object while the virtual line is displayed.
The line-of-sight guidance system according to any one of claims 1 and 2. The processing unit outputs video information for switching and displaying the display of the virtual line to a warning display.
The line-of-sight guidance system according to claim 1. Provided with gaze detection means for detecting the driver's gaze,
The processing unit changes the display of the alert display according to information by the line-of-sight detection means,
The line-of-sight guidance system according to any one of claims 1 to 4. A camera that captures an image of the driver's field of view in front of the vehicle;
A side camera that captures images outside the driver's field of view in front of the vehicle;
A road surface recognition unit that recognizes the road surface in front of the vehicle based on an image captured by the camera;
With
The processing unit outputs video information in which a tip of the virtual line overlaps the recognized road surface,
The processing unit recognizes an external object outside the visual field range of the driver ahead of the vehicle based on an image captured by the side camera, and outputs video information for displaying a warning display about the external object.
The line-of-sight guidance system according to any one of claims 1 to 5. The camera is a stereo camera;
The line-of-sight guidance system according to claim 6. A vehicle speed detector for detecting the vehicle speed of the vehicle;
The video display unit is a video projection unit that projects a video on the windshield,
The processing unit displays the virtual line on the video projection unit according to the vehicle speed from the vehicle speed detection unit so that the virtual line viewed from the driver extends from the upper edge of the windshield to the road surface. Output video information to change
The line-of-sight guidance system according to any one of claims 1 to 7.