WO2017013792A1 - Display control device and navigation device - Google Patents

Abstract

Display information for road marking information relating to route guidance is displayed in synchronization with the output timing of audio guidance so as to be emphasized and superimposed over corresponding road marking information in a front view.

Description

Display control device and navigation device

The present invention relates to a display control device for a head-up display (hereinafter referred to as HUD) that displays display information superimposed on a driver's forward view, and a navigation device equipped with the display control device.

Patent Document 1 describes a display system that changes the display position of information by HUD according to the importance of information. In this display system, information with high importance is displayed in a central display area where the driver can read information without diverting his gaze from the driving road ahead of the display area in the HUD, and information with low importance is displayed. It is displayed in the peripheral display area of the HUD. Thereby, the information with high importance displayed in the central display area can be visually recognized without the driver moving his / her line of sight.

Further, Patent Document 2 describes a HUD device that displays parallax to the left and right eyes of a driver to display information three-dimensionally. In this HUD device, map information such as roads, intersections or buildings along the roads can be displayed in a three-dimensional manner by superimposing them on the focal position of the driver's front view. Thereby, the driver can visually recognize the information without shifting the line of sight or the focus of the eyes.

Patent Document 3 describes a HUD device that detects an object that is being watched by a driver and displays information so as to form an image overlapping the object. In this HUD device, information is dynamically superimposed and displayed on the driver's gaze object, which can change from moment to moment, so that the driver does not move the line of sight and adjusts the focal length of the eyes. Can be visually recognized.

Furthermore, in Patent Document 4, only for a facility facing a road that is currently running, the information on the facility included in the landscape is superimposed on the position corresponding to this facility on the scene representing the real space or the image representing the landscape. The system to display is described. Each piece of information is displayed with a sense of perspective in a form attached to a portion facing the road on which the vehicle is currently traveling in the corresponding facility. Thereby, the visibility of the facility information or the actual scenery can be improved.

JP 2005-199992 A JP 2009-8722 A JP 2005-313772 A JP 2014-13989 A

In HUD, information such as vehicle information and route guidance is displayed superimposed on the focal position of the driver's forward field of view, so that the driver can quickly view the information with a small amount of line-of-sight movement.
However, when an object that the driver wants to pay attention to in front view and display information irrelevant to the object are displayed in an overlapping manner, both the object and the information are difficult to see.
Further, it is desirable that the display of information by the HUD is performed at a timing at which the driver can easily recognize the information content while the vehicle is traveling.

On the other hand, the display system described in Patent Document 1 narrows down information to be displayed in the central display area where the driver can read information without diverting the line of sight according to the importance of the information. The visibility of the displayed information is improved.
However, even if the information has a high degree of importance and is displayed in the central display area of the HUD, if the object that the driver wants to pay attention to in the front view and information that is irrelevant to the object are overlapped and displayed. , The visibility of both the object and the information is reduced.
In addition, when visually recognizing information displayed in the peripheral display area of the HUD, the driver needs to move his / her line of sight greatly, which reduces attention to the front of the vehicle.

The HUD device described in Patent Document 2 can display information three-dimensionally in the driver's forward field of view, but there is an object that the driver wants to focus on in the forward field of view and information unrelated to this object. There is a possibility of overlapping. In this case, both the object and the information are difficult to see.

The HUD device described in Patent Document 3 dynamically displays information superimposed on a driver's gaze object that can change from moment to moment, but no consideration is given to the display form of the information to be displayed in a superimposed manner. Since it is not done, both the gaze object and the information may be difficult to see.
The HUD device described in Patent Literature 4 is assumed to display information on a facility facing a currently traveling road on a portion facing the road of the facility and cannot be applied to route guidance.

Furthermore, in any of Patent Document 1 to Patent Document 3, the timing for displaying information on the HUD is not considered. For this reason, when information such as route guidance is displayed by the HUD at a timing that is difficult for the driver to recognize, the display ends without the driver being able to recognize the contents of the information, or the information of the information displayed by the driver by the HUD is displayed. Attention to driving may be reduced due to attention to recognize the contents.
In addition, although patent document 4 has a description about the timing which changes the display form of facility information from the state which is stuck on a facility to the state which turned to the front, as mentioned above, route guidance is not considered. .

SUMMARY OF THE INVENTION An object of the present invention is to provide a display control device and a navigation device that can display display information related to route guidance at a timing that makes it easy to see and recognize information content.

The display control apparatus according to the present invention includes a sign information acquisition unit, a timing generation unit, a display information generation unit, and an output control unit. The sign information acquisition unit acquires road sign information related to route guidance from road sign information detected in front of the vehicle. The timing determination unit determines whether it is the timing of voice guidance in route guidance. The display information generation unit generates display information for highlighting the road marking information acquired by the marking information acquisition unit so that the road marking information overlaps with the corresponding real road marking information in the forward field of view. The output control unit outputs display information to the display device in synchronization with the voice guidance timing determined by the timing determination unit.

According to the present invention, since the display information of the road marking information related to the route guidance is highlighted so as to overlap with the corresponding actual road marking information in the forward view, the easy-to-read route guidance emphasized in a natural form Display can be realized. Furthermore, since the road marking information related to the route guidance is displayed in synchronization with the timing of the voice guidance, the contents of the information to be recognized by the driver's auditory sense and the visual sense match, so that the contents of the display information can be easily recognized. .

It is a block diagram which shows the function structure of the navigation apparatus which concerns on Embodiment 1 of this invention. 3 is a block diagram illustrating a functional configuration of the display control apparatus according to Embodiment 1. FIG. 3 is a block diagram illustrating a hardware configuration of the display control apparatus according to Embodiment 1. FIG. 3 is a flowchart showing an outline of the operation of the display control apparatus according to the first embodiment. 4 is a flowchart showing a detailed operation of the display control apparatus according to the first embodiment. It is a figure which shows the scenery ahead of the vehicle seen through the front window before audio guidance. It is a figure which shows the scenery ahead of the vehicle seen through the front window at the timing which carries out voice guidance. It is a block diagram which shows the function structure of the display control apparatus which concerns on Embodiment 2 of this invention. 10 is a flowchart showing a detailed operation of the display control apparatus according to the second embodiment. It is a figure which shows the scenery ahead of the vehicle seen through the front window in which the additional display information was displayed in the empty space of the actual information sign. It is a figure which shows the scenery ahead of the vehicle seen through the front window in which the additional display information was displayed so that it might align with the actual guide sign. It is a figure which shows the scenery ahead of the vehicle seen through the front window displayed in the empty space of the actual information sign that the detour of the traffic jam is displayed, and that the traffic sign is displayed in line with the information sign. It is a block diagram which shows the function structure of the display control apparatus which concerns on Embodiment 3 of this invention. 10 is a flowchart showing a detailed operation of the display control apparatus according to the third embodiment. It is a figure which shows the scenery ahead of the vehicle seen through the front window by which the information unrelated to route guidance was mask-displayed. It is a block diagram which shows the function structure of the display control apparatus which concerns on Embodiment 4 of this invention. 10 is a flowchart showing a detailed operation of the display control apparatus according to the fourth embodiment. It is a block diagram which shows the function structure of the display control apparatus which concerns on Embodiment 5 of this invention. 10 is a flowchart showing a detailed operation of the display control apparatus according to the fifth embodiment.

Hereinafter, in order to describe the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
FIG. 1 is a functional block diagram showing a configuration of a navigation device 1 according to Embodiment 1 of the present invention. The navigation device 1 is a device that is mounted on a vehicle and performs route guidance to a destination, and includes an information acquisition unit 2, a control unit 3, a notification unit 4, an input unit 5, a map data storage unit 6, and a route calculation unit 7. And a route guide unit 8. The operation of each part of the navigation device 1 is comprehensively controlled by the control part 3.

The information acquisition unit 2 is a generic name for a configuration that acquires information detected by the current position of the host vehicle, the surroundings of the host vehicle, and other vehicles, and includes a current position detection unit 20, a wireless communication unit 21, and a surrounding information detection unit 22. .
The current position detection unit 20 is a component that detects the current position of the host vehicle, and is connected to a GPS (Global Positioning System) reception unit 20a, a direction detection unit 20b, and a pulse detection unit 20c.

The GPS receiver 20a receives a GPS signal from a GPS satellite, and detects the current position (for example, latitude and longitude) of the host vehicle based on the GPS signal. The direction detection unit 20b is a detection unit that detects the traveling direction (for example, the direction) of the host vehicle, and includes, for example, a gyro sensor and a direction sensor. The pulse detector 20c detects a pulse signal corresponding to the number of revolutions per unit time of the axle of the own vehicle, and detects the traveling speed and the traveling distance of the own vehicle based on the pulse signal.
The current position detecting unit 20 corrects the current position detected by the GPS receiving unit 20a based on the traveling direction, traveling speed, and traveling distance of the host vehicle detected by the direction detecting unit 20b and the pulse detecting unit 20c. Thereby, it becomes possible to detect the exact current position of the own vehicle.

The wireless communication unit 21 wirelessly communicates with a communication device mounted on another vehicle, and receives information indicating a situation around the own vehicle detected by the other vehicle. For example, road marking information detected by another vehicle traveling in front of the host vehicle is acquired.
The road marking information is information relating to road traffic guidance. For example, a guidance sign, a road marking, an information board, their contents, and the own vehicle when these and other vehicles are viewed as the own vehicle. Distance.
As for the guide sign, the position of the guide sign and the content of the guide sign become road marking information. The contents of the guide sign include a place name indicating the direction and an arrow sign indicating the direction.
As for the road marking, the position and the content of the road marking become road marking information. The contents of the road marking include an arrow marking indicating a traffic division according to the traveling direction, such as a straight lane or a left / right turn.
Regarding the information board, in addition to the position of the information board, the contents of the traffic information such as “30 km to Osaka, traffic jam, required time 40 minutes” displayed on the information board is also the road marking information.

The surrounding information detection unit 22 is connected to the external sensor 23 and detects information indicating the situation around the own vehicle from the information around the own vehicle detected by the external sensor 23. The information indicating the situation around the host vehicle includes, for example, road marking information in front of the host vehicle.
The external sensor 23 is a sensor group that detects information around the host vehicle, and includes a camera 23a, an image processing unit 23b, a radar 23c, and a radar control unit 23d.

The camera 23a is a camera capable of photographing in the visible light region or the infrared light region. For example, the camera 23a is arranged in the vicinity of a room mirror on the vehicle interior side of the front window of the own vehicle, and photographs the outside of a predetermined range ahead of the own vehicle in the traveling direction through the front window. As the camera 23a, for example, a CCD (Charge Coupled Device) camera, a CMOS (Complementary Metal Oxide Semiconductor) camera, a stereo camera, or the like is used.

The image processing unit 23 b performs image processing on the image captured by the camera 23 a into image data that can be processed by the surrounding information detection unit 22. For example, image data including two-dimensional array pixels is generated by performing image processing such as filtering and binarization processing. This image data is output to the surrounding information detection unit 22.

The radar 23c is a sensor that detects an object around the vehicle using a laser beam or a millimeter wave as a probe. For example, it is arranged near the nose portion of the vehicle body of the own vehicle or the front window on the vehicle interior side. Further, the radar 23c transmits a laser beam or millimeter wave transmission signal in the detection target direction under the control of the radar control unit 23d, and receives a reflection signal obtained by reflecting the transmission signal by an external object. The detection target direction includes the traveling direction of the own vehicle.

The radar control unit 23d generates a beat signal obtained by mixing the reflected signal and the transmission signal received by the radar 23c, and outputs the beat signal to the ambient information detection unit 22.
The radar control unit 23d controls the operation of the radar 23c in accordance with a control command input from the surrounding information detection unit 22.

The surrounding information detection unit 22 determines whether or not the image data obtained from the external sensor 23 includes a predetermined detection target image. The detection object is, for example, road marking information such as a guide sign, road marking, and information board in front of the host vehicle.

When it is determined that the image of the detection target is included in the image data, the surrounding information detection unit 22 determines the distance between the reference position in the entire image indicated by the image data and the detection target (hereinafter referred to as the first distance). Calculated). The reference position is, for example, the center position in the horizontal direction of the entire image indicated by the image data.
In addition, the ambient information detection unit 22 calculates a distance between the detection target and the host vehicle (hereinafter referred to as a second distance) based on the beat signal input from the external sensor 23.
When the camera 23a is a stereo camera, the second distance can be calculated using the parallax with respect to the detection target in the stereo camera.

The surrounding information detection unit 22 calculates the relative position of the detection target object with respect to the position of the own vehicle in the horizontal direction based on the first distance and the second distance. The relative position of the detection target is, for example, a relative position obtained from a difference in latitude and longitude coordinates. Thereafter, the surrounding information detection unit 22 calculates the current position of the detection object based on the relative position of the detection object and the current position of the host vehicle.
When the detection object is a guide sign, a road marking, or an information board, the surrounding information detection unit 22 outputs the distance between these marking objects and the own vehicle to the later-described signing information acquisition unit 30 as road marking information.

The notification unit 4 is a generic name for a configuration in which the navigation device 1 notifies the user of information, and includes a navigation display unit 4a, a HUD display unit 4b, a display control unit 4c, an audio output unit 4d, and an audio control unit 4e. The navigation display unit 4a is a display on which map display and route guidance display are performed, and is arranged, for example, in the front center of the vehicle interior. The HUD display unit 4b projects and displays the display information on the front window or the combiner.
However, since the road marking information related to the route guidance is displayed so as to overlap the corresponding real road marking information in the driver's front field of view, the front window is an object to be projected and displayed. desirable.

The display control unit 4c causes the navigation display unit 4a to display the map image and the guidance image based on the image data including the map image and the guidance image input from the control unit 3. Further, the display control unit 4c causes the HUD display unit 4b to display the display information input from the control unit 3.
The HUD device 4A embodies the display device according to the present invention, and includes a HUD display unit 4b and a display control unit 4c.

The voice output unit 4d is an output unit that outputs a guidance voice, a warning sound, and the like, and is realized by a speaker mounted on the vehicle.
Also, the voice control unit 4e causes the voice output unit 4d to output guidance voice, warning sound, and the like based on voice data such as guidance voice and warning sound input from the control unit 3.
The audio output device 4B embodies the audio output device of the present invention, and includes the audio output unit 4d and the audio control unit 4e described above. That is, in the audio output device 4B, the audio control unit 4e controlled by the control unit 3 outputs audio information to the audio output unit 4d to output audio.
The navigation device 1 controls the notification unit 4 to notify the driver of the own vehicle of information for assisting driving.

The input unit 5 is a component that receives information input from the user, and is realized by, for example, a push button device or a touch panel. The touch panel may be integrated with the navigation display unit 4a. A destination to be route-guided from the current position is input using the input unit 5. For example, when a point on the map displayed on the navigation display unit 4a is designated by the user, the input unit 5 accepts this point as a destination, and when an address or telephone number is input, this address or telephone number Is received as destination information for specifying the destination.

The map data storage unit 6 is a storage unit that stores map data, and is realized as a storage device such as an HDD (Hard Disk Drive) or a RAM (Random Access Memory). Note that the map data storage unit 6 may store map data acquired from the outside of the navigation device 1.
For example, the map data storage unit 6 stores map data downloaded from an external device via a network. The map data storage unit 6 stores map data read from a recording medium such as a DVD-ROM (Digital Versatile Disk-Read Only Memory) or a BD-ROM (Blu-Ray (registered trademark) Disc-ROM). Also good.

The route calculation unit 7 calculates a route from the departure point to the destination based on the departure point, the destination, and the map data. For example, the current position of the host vehicle detected by the current position detection unit 20 is set as the departure place. The destination may be a point received by the input unit 5 from the user, or may be a point registered in advance as a destination candidate.
The route calculated by the route calculation unit 7 travels as much as possible on, for example, a route with a short arrival time (time priority route), a route with a short travel distance (distance priority route), a route with less fuel (fuel priority route), and a toll road. There are a route (toll road priority route), a route traveling on a general road as much as possible (general road priority route), a route (standard route) with a good balance of time, distance and cost.

The route guidance unit 8 provides route guidance for a route selected by the user (hereinafter, referred to as a scheduled travel route) among the routes calculated by the route calculation unit 7. For example, the route guidance unit 8 performs route guidance from the current position to the destination along the planned travel route by controlling the notification unit 4 to notify the driver of route guidance information.

Moreover, each function with which the display control apparatus which concerns on Embodiment 1 is provided is implement | achieved by each function regarding the display control in the control part 3. FIG.
FIG. 2 is a block diagram illustrating a functional configuration of the display control apparatus according to the first embodiment, and illustrates each function of the control unit 3 that is a function of the display control apparatus according to the first embodiment.
As shown in FIG. 2, the control unit 3 includes a labeling information acquisition unit 30, a timing determination unit 31, a display information generation unit 32, and an output control unit 33 as functions for controlling the display of the HUD device 4 </ b> A.

The sign information acquisition unit 30 acquires road sign information related to route guidance from road sign information detected in front of the host vehicle. For example, the marking information acquisition unit 30 uses the road marking information detected in front of the vehicle by the surrounding information detection unit 22 as road marking information related to route guidance in the route guidance unit 8 and road marking information not related to route guidance. And road marking information related to route guidance is acquired. As a classification method, for example, a method of identifying information related to route guidance by comparing the guidance signs, road markings, information boards and their contents with the route guidance information of the planned travel route in the road marking information is adopted. Is done.

For example, the sign information acquisition unit 30 analyzes the image data obtained by the image processing of the image processing unit 23b via the surrounding information detection unit 22, and specifies the content of the road sign information. Here, when the road marking information is a guide sign, the place name described in the guide sign, the contents of the sign such as an arrow sign, and the position in the guide sign where the contents of the sign are described are specified.
When the road marking information is a road marking, the marking information acquisition unit 30 analyzes the road surface image data in front of the own vehicle acquired from the surrounding information detection unit 22 to identify the content of the road marking, and the driver's line of sight And the angle formed by the road surface.

When the route guidance at the guidance point is a left turn, the sign information acquisition unit 30 sets the road marking indicating the left turn as road marking information related to the route guidance, and the road marking information for straight and right turns indicates the road marking information not related to the route guidance. Classify into: In addition, when the route is guided to the direction of “Sannomiya” at the guide point, the sign information acquisition unit 30 routes “Sannomiya” if “Sannomiya” and “Osaka” are specified as the place names indicating the direction of the guidance sign. The road marking information related to the guidance is used, and “Osaka” is classified as road marking information not related to the route guidance.

The timing determination unit 31 determines whether or not it is the timing at which the route guide unit 8 guides the planned travel route by voice. In the planned travel route, a guidance point where voice guidance is performed is determined in advance. The guide point is a point where it is necessary to determine the traveling direction of the vehicle on the planned travel route, and includes an intersection, an entrance / exit of an expressway, and the like.

For example, the timing determination unit 31 acquires the route guidance information of the planned travel route used by the route guidance unit 8 for route guidance and the current position of the host vehicle, and the host vehicle is within a predetermined range with respect to the guide point. It is determined whether or not. And the timing determination part 31 determines with it being the timing of voice guidance, when it arrives within this range.
Note that the predetermined range is a range determined in terms of time or distance between the guide point and the vehicle position, and the output control unit 33 performs this voice guidance during the period when the voice guidance is output. This is a range in which related display information can be displayed on the HUD device 4A.
That is, the timing at which the period during which the voice guidance is output and the period during which the display information corresponding to the period is displayed overlaps with the timing at which voice guidance is performed.

The display information generation unit 32 generates display information for highlighting the road marking information related to the route guidance so that the road marking information appears to overlap the corresponding real road marking information in the forward view.
For example, when the road marking information related to the route guidance is information on the direction and direction of the guidance sign, as the display information for displaying the direction and direction so that the direction and direction are displayed so as to overlap the direction sign, The image data is generated in which the characters of the place name indicating and the arrow mark indicating the direction are highlighted in highlight color.
In addition, when the road marking information related to the route guidance is the traffic information “30 km to Osaka, traffic jam, required time 40 minutes” displayed on the information board, it appears to overlap the display part of this information board As display information to be displayed, image data in which characters indicating the traffic information are highlighted in a highlight color is generated.

In addition, when the road marking information related to the route guidance is the left / right turn arrow marking of the road marking, the right / left turn arrow marking is highlighted as display information to be displayed so as to overlap the road marking. Emphasized image data is generated. At this time, based on the angle formed by the driver's line of sight and the road surface, the display information generating unit 32 generates an image in which the shape of the arrow sign is deformed so that the driver can see the arrow mark on the actual road surface. To do. Thereby, the display information of a road marking can be made into the shape close | similar to an actual road marking seeing from a driver | operator.

Further, the display information generation unit 32 has a size and shape corresponding to the distance between the position of the actual road marking information and the own vehicle based on the content of the road marking information sequentially input from the marking information acquisition unit 30. Image data indicating road marking information is generated as display information.
The display information generated by the display information generation unit 32 is displayed in a relatively short period while the voice guidance corresponding to the display information is output. Even in this period, the display information of the road marking information is displayed. There is a possibility that the size and shape of the image will not match, and the actual road marking information will deviate.
Therefore, the display data is used as image data indicating the size and shape of the road marking information according to the distance between the position of the actual road marking information and the host vehicle, thereby reducing the deviation from the actual road marking information. be able to.

The output control unit 33 outputs display information to the HUD device 4A in synchronization with the voice guidance timing determined by the timing determination unit 31. Thereby, in the HUD device 4A, the display information is projected on the front window or the combiner and highlighted so as to overlap the corresponding real road marking information in the front view. In other words, the output control unit 33 controls the display control unit 4c to output the display information input from the display information generation unit 32 to the HUD device 4A when the voice guidance timing comes.

In the HUD device 4A, by adjusting the distance between the display source and the lens that projects the display light from the display source onto the front window, a virtual image is formed at an arbitrary distance from the relationship with the focal length of the lens. be able to. The output control unit 33 controls the display control unit 4c to adjust the distance between the lens of the HUD device 4A and the display source.

By adjusting the distance between the lens of the HUD device 4A and the display source, for example, when the road marking information related to the route guidance is information on the direction and direction of the guidance sign, the place name and direction arrow indication in the direction are high. The display information highlighted in the light color is displayed so as to be pasted on the part where the corresponding direction and direction in the actual guide sign are described.
If the road marking information related to the route guidance is a road marking, the display information in which the right and left turn arrow markings are highlighted is highlighted so that it is pasted on the corresponding actual road marking. To display.
In addition, the output control part 33 changes the display position of display information according to driving | running | working of the own vehicle, and makes the display of the display information in the HUD apparatus 4A follow the movement of the own vehicle.

FIG. 3 is a block diagram illustrating a hardware configuration of the display control apparatus according to the first embodiment. FIG. 4 is a flowchart showing an outline of the operation of the display control apparatus according to the first embodiment.
In FIG. 3A, a display 101 is the HUD device 4A shown in FIG. 1, and the display is controlled by the display control device according to the first embodiment. The speaker 102 is the audio output unit 4d shown in FIG. 1, and is, for example, a speaker mounted on a vehicle.

As described above, each function related to display control in the control unit 3 corresponds to each function of the display control apparatus according to the first embodiment. The sign information acquisition unit 30, the timing determination unit 31, the display information generation unit 32, and the output control unit 33 in the control unit 3 are realized by the processing circuit 100.
That is, in the display control apparatus, the sign information acquisition unit 30 executes the process of step ST1 shown in FIG. 4, the timing determination unit 31 executes the process of step ST2, and the display information generation unit 32 executes the process of step ST3. The output control unit 33 includes a processing circuit 100 for executing the process of step ST4. The processing circuit 100 is a component that implements the control unit 3 and may be dedicated hardware or a CPU (Central Processing Unit) that executes a program stored in a memory.

When the processing circuit 100 is dedicated hardware, the processing circuit 100 includes, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (FPGA). Field-Programmable Gate Array) or a combination thereof. The functions of each part of the sign information acquisition unit 30, the timing determination unit 31, the display information generation unit 32, and the output control unit 33 may be realized by a processing circuit, respectively, or the functions of each unit may be realized by a single processing circuit. May be.

As shown in FIG. 3B, when the processing circuit is the CPU 103, the functions of the marking information acquisition unit 30, the timing determination unit 31, the display information generation unit 32, and the output control unit 33 are software, firmware, or software. This is realized by a combination of firmware and firmware. Software and firmware are described as programs and stored in the memory 104. The CPU 103 reads out and executes the program stored in the memory 104, thereby realizing the functions of each unit. That is, the display control apparatus includes a memory 104 for storing a program that, when executed by the CPU 103, results from the processing from step ST1 to step ST4 shown in FIG.
In addition, these programs cause the computer to execute the procedures or methods of the sign information acquisition unit 30, the timing determination unit 31, the display information generation unit 32, and the output control unit 33. Here, the memory is, for example, a RAM (Random Access Memory), a ROM, a flash memory, an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Programmable EPROM), or a non-volatile or volatile semiconductor memory, a magnetic disk, a flexible disk, An optical disc, a compact disc, a mini disc, a DVD, and the like are applicable.

Note that some of the functions of the sign information acquisition unit 30, the timing determination unit 31, the display information generation unit 32, and the output control unit 33 may be realized by dedicated hardware, and may be realized by software or firmware. Good.
For example, the function of the sign information acquisition unit 30 is realized by the processing circuit 100 as dedicated hardware, and the CPU 103 is stored in the memory 104 for the timing determination unit 31, the display information generation unit 32, and the output control unit 33. The function can be realized by reading and executing the program.
As described above, the processing circuit can realize the above-described functions by hardware, software, firmware, or a combination thereof.

Next, the operation will be described.
FIG. 5 is a flowchart showing a detailed operation of the display control apparatus according to the first embodiment. In FIG. 5, processing from step ST1a to step ST6a is an example of detailed processing of step ST1 shown in FIG. Moreover, the process of step ST7a is an example of the detailed process of step ST2 shown in FIG. 4, and the process of step ST8a is an example of the detailed process of step ST3 shown in FIG. The processing from step ST9a to step ST10a is an example of detailed processing of step ST4 shown in FIG.
Therefore, the operation of each step in FIG. 4 becomes clear by explaining each step in FIG. 5, and will be described below with reference to FIG.

First, the sign information acquisition unit 30 determines whether or not the planned travel route of the vehicle has been calculated (step ST1a). For example, the route guidance unit 8 is inquired whether route guidance is performed along the planned travel route, and when the route guidance is performed, it is determined that the planned travel route is calculated, and the route is calculated. When the guidance is not performed, it is determined that the planned travel route has not been calculated. When it is determined that the planned travel route has not been calculated (step ST1a; NO), the process proceeds to step ST10a.

Next, when it is determined that the planned travel route has been calculated (step ST1a; YES), the marking information acquisition unit 30 detects road marking information ahead of the vehicle by the surrounding information detection unit 22 in the information acquisition unit 2. It is determined whether or not it has been done (step ST2a). Here, when the road marking information ahead of the host vehicle is not detected (step ST2a; NO), the process of step ST2a is repeated. When road marking information in front of the host vehicle is detected (step ST2a; YES), the marking information acquisition unit 30 receives from the surrounding information detection unit 22 a sign such as a guide sign, road marking, and display board in the road marking information. The distance to the car is acquired (step ST3a).

Next, the sign information acquisition unit 30 determines the content of the road sign information (step ST4a).
For example, the sign information acquisition unit 30 performs image analysis on the image data obtained by the image processing of the image processing unit 23b via the surrounding information detection unit 22, and determines the content of the road sign information.
When the road marking information is a guide sign, the name of the place described on the guide sign, the contents of the sign such as an arrow sign, and the position in the guide sign where the contents of the sign are described are determined.
When the road marking information is a road marking, an arrow marking indicating a traffic classification according to the traveling direction, such as a straight lane or a left / right turn, is determined.
When the road marking information is the information displayed on the information board, the contents of traffic information such as “30 km to Osaka, traffic jam, required time 40 minutes” displayed on the information board are determined.

Subsequently, the marking information acquisition unit 30 compares the content of the road marking information determined in step ST4a with the route guidance information of the planned travel route (step ST5a), and whether there is road marking information related to the route guidance. Is determined (step ST6a).
That is, the sign information acquisition unit 30 uses the road sign information detected in front of the host vehicle by the surrounding information detection unit 22 as road sign information related to the route guidance in the route guide unit 8 and the road sign not related to the route guidance. Classified as information.

If there is no road marking information related to route guidance in the road marking information detected in front of the vehicle by the surrounding information detection unit 22 (step ST6a; NO), the process returns to step ST2a.
On the other hand, when there is road marking information related to the route guidance (step ST6a; YES), the marking information acquisition unit 30 includes the route guidance among the road marking information detected by the surrounding information detection unit 22 in front of the host vehicle. The road marking information related to is acquired and output to the display information generation unit 32.

Next, the timing determination unit 31 determines whether or not it is a timing for voice guidance of the planned travel route by the route guidance unit 8 (step ST7a).
As described above, for example, based on the route guidance information of the planned travel route and the current position of the host vehicle, it is determined whether or not the host vehicle has reached a predetermined range with respect to the guide point. When it reaches inside, it is determined that it is the timing of voice guidance.
When it is determined that it is not the timing of voice guidance (step ST7a; NO), the process of step ST7a is repeated until the timing of voice guidance is reached.

When the timing determination unit 31 determines that it is the timing of voice guidance (step ST7a; YES), the display information generation unit 32 highlights the road marking information related to this voice guidance in the highlight color and this voice guidance. Display information expressed in a form suitable for an actual sign corresponding to is generated (step ST8a).
Next, the output control unit 33 outputs voice guidance to the voice output device 4B, and outputs the display information generated by the display information generation unit 32 to the HUD device 4A in synchronization with this timing. As a result, the display information is highlighted so as to overlap the corresponding actual road marking information in the front view through the front window (step ST9a).

Thereafter, the output control unit 33 determines whether or not an operation for stopping the display by the HUD device 4A has been received by the input unit 5 (step ST10a). When this operation is received by the input unit 5 (step ST10a; YES), the process of FIG. 5 is terminated.
Moreover, when the said operation is not received by the input part 5 (step ST10a; NO), it returns to the process of step ST1a.

Next, display of display information in the HUD device 4A will be described.
FIG. 6 is a diagram showing a landscape in front of the vehicle viewed through the front window before voice guidance, and shows a state in front of the host vehicle when the vehicle approaches an intersection where voice guidance is performed.
A guide sign 9 is arranged in the vicinity at the intersection shown in FIG. 6, and a right turn arrow 10 and a straight arrow 11 are marked on the road surface on which the vehicle travels. As shown in FIG. 6, when it is not the timing of voice guidance at this intersection, display information related to route guidance is not displayed.

FIG. 7 is a diagram showing the scenery in front of the vehicle viewed through the front window at the timing of voice guidance, and shows the case where the vehicle approaches the intersection further from the state of FIG. 6 and the timing of voice guidance is reached. ing. In FIG. 7, the road marking information related to the route guidance is information indicating the direction “Sannomiya” in the direction of the actual guidance sign 9 and the right direction, and the road marking of the right turn arrow 10.
At this time, the display information generation unit 32 generates, as the display information 9a, image data obtained by applying highlight color to the characters “Sannomiya” indicating the direction and the arrow indicating the right direction.
Further, the display information generation unit 32 generates, as display information 10a, image data obtained by adding a highlight color to the shape that matches the right turn arrow 10.

The output control unit 33 generates display information for the HUD device 4A in synchronism with the output timing of the voice guidance “Please turn right ahead. Right direction, in the direction of Sannomiya” in the audio output device 4B. The display information generated by the unit 32 is output.
By doing in this way, the display information 9a in which the direction “Sannomiya” and the arrow mark in the right direction are expressed in highlight color is described by the HUD device 4A, and the corresponding direction and direction of the actual guide sign 9 are described. It appears as if it were pasted at the location.
Similarly, the HUD device 4A displays the display information 10a in which the right turn arrow mark is displayed in a highlighted color so as to be pasted on the corresponding actual right turn arrow 10.

As described above, in the display control device according to the first embodiment, the road marking information display information 9a and 10a related to the route guidance is displayed in the road corresponding to the driver's front view in synchronization with the timing of the voice guidance. Highlight so that it appears to overlap the marking information.
In particular, the display information generation unit 32 generates display information 9a and 10a for highlighting road marking information related to the contents of voice guidance.
Thereby, it is possible to realize easy-to-see route guidance display emphasized in a natural manner. Furthermore, the contents of the information to be recognized visually and the driver's hearing are easy to recognize because the contents of the display information are the same.

Embodiment 2. FIG.
FIG. 8 is a block diagram illustrating a functional configuration of the display control apparatus according to the second embodiment, and illustrates each function of the control unit 3A that is a function of the display control apparatus according to the second embodiment.
As illustrated in FIG. 8, the control unit 3A includes a labeling information acquisition unit 30a, a timing determination unit 31, a display information generation unit 32a, and an output control unit 33a as functions for controlling the display of the HUD device 4A. In FIG. 8, the same components as those in FIG.

The sign information acquisition unit 30a acquires the content of the route guidance that is not included in the road sign information related to the route guidance from the road marking information related to the route guidance by the route guide unit 8.
Here, the road marking information detected in front of the vehicle by the surrounding information detection unit 22 is classified into road marking information related to the route guidance in the route guidance unit 8 and road marking information not related to the route guidance. Subsequently, the road marking information related to the route guidance is compared with the content of the route guidance, and the content of the route guidance not included in the road marking information is extracted and acquired as information to be additionally displayed.
For example, the road marking information related to route guidance is in the direction of “Sannomiya” in the direction of the guidance sign, and the content of the route guidance includes the remaining distance from the current position to the destination in the direction of “Sannomiya”. Is included as information to be additionally displayed.

The route guidance information to be compared with the road marking information related to the route guidance also includes traffic information related to the planned travel route.
For example, when the road on the right in the direction of “Sannomiya” is congested, the sign information acquisition unit 30a additionally displays character information indicating “congested” and information indicating a detour to avoid this traffic jam Extract as

The display information generation unit 32a generates additional display information for displaying the contents of route guidance that is not included in the road marking information related to route guidance. The road marking information related to the route guidance is the information indicating the direction “Sannomiya” and the right direction on the guidance sign. Until the content of the route guidance not in this information arrives at the destination from the current position toward “Sannomiya” A case where the information is the remaining distance (5 km) is taken as an example. In this case, the display information generation unit 32a generates, as additional display information, image data in which character information “5 km remaining” indicating the remaining distance is expressed in highlight color.

The output control unit 33a outputs additional display information to the HUD device 4A. Thereby, the additional display information is displayed by the HUD device 4A as if it is pasted in the empty space of the corresponding real sign object in the front view. Alternatively, the additional display information is displayed so as to be pasted at a position adjacent to the corresponding real sign in the forward view.
As the sign corresponding to the additional display information, for example, when the additional display information is the remaining distance toward the “Sannomiya” direction, the guide sign describing the “Sannomiya” direction is the sign corresponding to the additional display information. It is determined to be a thing.

Next, the operation will be described.
FIG. 9 is a flowchart showing a detailed operation of the display control apparatus according to the second embodiment. In FIG. 9, the processing from step ST1a to step ST6a, step ST7a and step ST8a, and step ST10a is the same as the processing from step ST1a to step ST6a, step ST7a and step ST8a, and step ST10a shown in FIG. Omitted.

Further, the processing from step ST1a to step ST6a-3 in FIG. 9 is an example of detailed processing of step ST1 shown in FIG.
The process of step ST7a is an example of the detailed process of step ST2 shown in FIG. 4, and the process from step ST8a to step ST8a-1 is an example of the detailed process of step ST3 shown in FIG. The processing from step ST9b to step ST10a is an example of detailed processing of step ST4 shown in FIG.
Therefore, since the operation of each step in FIG. 4 becomes clear by explaining each step in FIG. 9, the following description will be made based on FIG.

The marking information acquisition unit 30a compares the content of the road marking information related to the route guidance with the route guidance information of the planned travel route (step ST6a-1), and performs voice guidance not included in the road marking information related to the route guidance. It is determined whether or not there is content (step ST6a-2).
That is, the marking information acquisition unit 30a compares the road marking information related to the route guidance with the content of the route guidance indicated by the route guidance information, and specifies the content of the route guidance not included in the road marking information.

If there is no voice guidance content not included in the road marking information related to the route guidance (step ST6a-2; NO), the process proceeds to step ST7a.
When there is a voice guidance content not included in the road marking information related to the route guidance (step ST6a-2; YES), the marking information acquisition unit 30a extracts the content of the voice guidance as information to be additionally displayed (step ST6a- 3).
For example, when the road marking information related to route guidance is in the right direction with the direction “Sannomiya” in the guidance sign, the remaining distance to the destination, estimated arrival time, traffic jam information, etc. are additionally displayed in the route guidance information. Extracted as information.

The display information generation unit 32a generates display information in which the information to be additionally displayed input from the sign information acquisition unit 30a is expressed in a highlight color and in a form suitable for an actual sign corresponding to this information ( Step ST8a-1).
Next, the output control unit 33a outputs the display information and additional display information generated by the display information generation unit 32 to the HUD device 4A in synchronization with the timing at which the voice guidance is output.
The display information and the additional display information generated by the display information generation unit 32 are highlighted so as to appear to overlap the corresponding actual road marking information in the driver's front view (step ST9b).

Next, display of display information in the HUD device 4A will be described.
FIG. 10 is a view showing the scenery in front of the vehicle seen through the front window in which the additional display information 9b is displayed in the empty space of the actual guidance sign 9, and the vehicle approaches the intersection and the voice guidance timing is reached. It shows the case.
FIG. 11 is a view showing a scenery in front of the vehicle viewed through the front window on which the additional display information 9c is displayed so as to be aligned with the guide sign 9. FIG.
Here, the road marking information related to the route guidance is information indicating the direction “Sannomiya” and the right direction described in the guidance sign, and the content of the route guidance not included in this information is from the current position to the direction “Sannomiya”. This shows a case where the remaining distance until the destination is reached (more 5 km).

The display information generation unit 32a generates, as display information 9a, image data obtained by highlighting the characters “Sannomiya” indicating this direction and the arrow mark indicating the right direction in the actual guide sign 9. In addition, the display information generation unit 32a generates, as display information 10a, image data obtained by applying a highlight color to a shape that matches the actual right turn arrow 10. Further, the display information generation unit 32a generates additional display information 9b and 9c in which the character information “5 km remaining” indicating the remaining distance is expressed in highlight color.

The output control unit 33a displays the display information 9a generated by the display information generation unit 32a in synchronism with the output timing of the voice guidance “Please turn right ahead. There is another 5km in the right direction toward Sannomiya”. , 10a is output to the HUD device 4A. Thereby, the display information 9a is displayed by the HUD device 4A so as to be pasted at the position where the corresponding direction and direction of the actual guide sign 9 are described, and the display information 10a is displayed in correspondence with the actual right turn arrow. 10 is displayed as being pasted.

Further, the output control unit 33a outputs additional display information 9b and 9c in which the character information “5 km” is expressed in highlight color to the HUD device 4A in synchronization with the voice guidance timing. Thereby, the additional display information 9b is displayed in the empty space of the guide sign 9 as shown in FIG. 10, or the additional display information 9c is aligned with the guide sign 9 as shown in FIG. Is displayed.

FIG. 12 is a view showing a scenery in front of the vehicle viewed through the front window in which a detour of a traffic jam is displayed in an empty space of the actual guidance sign 9 and that it is displayed that the traffic jam is aligned with the guidance sign 9 It is. FIG. 12 shows a case where the road marking information related to the route guidance is information indicating the direction “Sannomiya” described in the guidance sign and the right direction. Further, the content of the route guidance that does not exist in the road marking information indicates that the road in the right direction is congested in the direction of “Sannomiya” and is information indicating a detour to avoid this traffic jam.

The display information generation unit 32a generates, as display information 9a, image data in which characters of “Sannomiya” indicating this direction in the actual guide sign 9 are expressed in highlight color.
In addition, the display information generation unit 32a generates, as display information 10a, image data in which a highlight color is applied to a shape that matches the right turn arrow 10 in an actual road marking.
Further, the display information generation unit 32a generates, as additional display information 9d, image data in which an arrow sign indicating a detour that detours from the right direction toward the “Sannomiya” direction is highlighted.
In addition, the display information generation unit 32a generates, as additional display information 9e, image data in which character information “detour” is expressed in highlight color, and character information “in traffic jam” is expressed in highlight color. Additional display information 9f is generated.

In the voice output device 4B, the output control unit 33a, for example, synchronizes with the timing at which the voice guidance saying “There is a traffic jam in the right direction in the direction of Sannomiya. The display information 10a is output to the HUD device 4A.
Thereby, for example, the display information 10a in which the right turn arrow sign is expressed in highlight color is displayed as if it is pasted on the actual right turn arrow 10 corresponding thereto.
Further, the additional display information 9d is displayed as pasted on the arrow display of the actual guide sign 9 corresponding thereto.
Further, the additional display information 9e is displayed in the empty space of the actual guide sign 9 corresponding thereto, and the additional display information 9f is displayed at a position adjacent to the guide sign 9.

As described above, in the display control apparatus according to the second embodiment, the display information generating unit 32a displays the additional display information 9c to 9f for displaying the contents of the route guidance that does not exist in the road marking information related to the route guidance. Generate. The output control unit 33a outputs additional display information 9c to 9f to the HUD device 4A. In this way, by additionally displaying the contents of the route guidance that is not included in the road marking information related to the route guidance, the contents of the information that should be recognized by the driver's auditory sense and visual sense match, and the contents of the additional display information are recognized. It becomes easy. Further, by additionally displaying the empty space of the guide sign 9 or the position adjacent to the guide sign 9, it is possible to realize easy-to-see route guidance display emphasized in a natural manner.

Embodiment 3 FIG.
FIG. 13 is a block diagram illustrating a functional configuration of the display control apparatus according to the third embodiment, and illustrates each function of the control unit 3B that is a function of the display control apparatus according to the third embodiment.
As illustrated in FIG. 13, the control unit 3B includes a labeling information acquisition unit 30b, a timing determination unit 31, a display information generation unit 32b, and an output control unit 33b as functions for controlling the display of the HUD device 4A. In FIG. 13, the same components as those in FIG.

The marking information acquisition unit 30b converts the road marking information detected in front of the vehicle by the surrounding information detection unit 22 into road marking information related to the route guidance in the route guidance unit 8 and road marking information not related to the route guidance. Categorize and get both of these.
For example, if the road marking information related to route guidance is the direction “Sannomiya” in the direction of the guidance sign, and the direction of “Osaka” is also indicated on this guidance sign, the direction of “Osaka” is also used for route guidance. Acquired as unrelated road marking information.

The display information generation unit 32b generates display information for highlighting road marking information related to the route guidance, and displays mask display information for masking road marking information not related to the route guidance for the forward view. Generate.
An example is given in which the road marking information related to the route guidance is the direction “Sannomiya” in the direction of the guidance sign and the right direction, and the content not related to this information is the direction “Osaka” and the straight direction.
In this case, the display information generation unit 32b generates character information indicating “Sannomiya” and an image expressing the right arrow mark in highlight color as display information. In addition, the display information generation unit 32b generates mask display information for mask-displaying the character information indicating “Osaka” and the arrow mark in the straight direction.
The display information for mask is image information in which the content of the base displayed in a superimposed manner is translucent or shielded.

The output control unit 33b outputs the display information generated by the display information generation unit 32b to the HUD device 4A, and outputs mask display information.
Thus, for example, when the road marking information related to the route guidance is information indicating the direction “Sannomiya” and the right direction in the guidance sign, the character information indicating “Sannomiya” and the arrow indication in the right direction are expressed in highlight color. The displayed information is displayed so as to overlap “Sannomiya” in the actual information sign and the arrow mark in the right direction. Further, when the road marking information not related to the route guidance is information indicating the “Osaka” direction and the straight direction, the mask display information is displayed so as to overlap the “Osaka” direction and the position in the straight direction.

Next, the operation will be described.
FIG. 14 is a flowchart showing a detailed operation of the display control apparatus according to the third embodiment. In FIG. 14, the processing from step ST1a to step ST8a and step ST10a is the same as the processing from step ST1a to step ST8a and step ST10a shown in FIG.

Further, the processing from step ST1a to step ST6a in FIG. 14 is an example of detailed processing of step ST1 shown in FIG.
The process of step ST7a is an example of the detailed process of step ST2 shown in FIG. 4, and the process from step ST8a to step ST8b-1 is an example of the detailed process of step ST3 shown in FIG. The processing from step ST9c to step ST10a is an example of detailed processing of step ST4 shown in FIG.
Therefore, the operation of each step in FIG. 4 becomes clear by explaining each step in FIG. 14, and will be described below with reference to FIG.

In step ST8b-1, the display information generation unit 32b generates mask display information for mask display of road marking information not related to route guidance.
Next, the output control unit 33b outputs the display information generated by the display information generation unit 32 to the HUD device 4A in synchronization with the timing at which the voice guidance is output by the voice output device 4B. The display information is highlighted by the HUD device 4A so as to be superimposed on the corresponding road marking information in the driver's front field of view, and the mask display information is displayed (step ST9c).

Next, display of display information in the HUD device 4A will be described.
FIG. 15 is a diagram showing the scenery in front of the vehicle viewed through the front window on which information not related to route guidance is displayed as a mask, and shows the case where the vehicle approaches the intersection and the timing of voice guidance is reached. . Here, the road marking information related to the route guidance is the information indicating the direction of the direction “Sannomiya” and the right direction, and the road marking information not related to the route guidance is the direction of “Osaka” and a straight arrow. Show.

The display information generation unit 32b generates, as the display information 9a, an image obtained by highlighting the characters “Sannomiya” indicating this direction and the arrow mark indicating the right direction in the actual guide sign 9.
In addition, the display information generation unit 32a generates, as the display information 10a, an image in which a highlight color is applied to a shape that matches the right turn arrow 10 in an actual road marking.

Further, the display information generating unit 32b generates mask display information 9g that shields the direction of “Osaka” in the actual guide sign 9 and its direction.
The display information generation unit 32b also generates the road marking of the straight arrow 11 as mask display information 11a that shields the straight arrow 11 in the actual road marking because the road marking is not related to the route guidance.

The output control unit 33b uses the voice output device 4B to synchronize with the timing at which the voice guidance “Please turn right. 10a is output.
Thereby, the display information 9a is displayed by the HUD device 4A so as to be pasted at the position where the corresponding direction and direction of the actual guide sign 9 are described, and the display information 10a is displayed in correspondence with the actual right turn arrow. 10 is displayed as being pasted.

Further, the output control unit 33b outputs the mask display information 9g and 11a to the HUD device 4A in synchronization with the voice guidance timing.
As a result, the mask display information 9g is displayed so as to overlap the position where the direction of “Osaka” and the direction of the guide sign 9 are described. The mask display information 11a is displayed so as to be pasted on the straight-going straight arrow 11.

As described above, in the display control apparatus according to the third embodiment, the display information generation unit 32b generates mask display information 9g and 11a for mask-displaying road marking information that is not related to the route guidance for the forward view. . The mask display information 9g and 11a are displayed by the HUD device 4A so as to be superimposed on the road marking information not related to the route guidance for the front view.
Thus, since the road marking information not related to the route guidance is displayed as a mask, it becomes easier for the driver to recognize the display information of the road marking information related to the route guidance.

Embodiment 4 FIG.
FIG. 16 is a block diagram illustrating a functional configuration of the display control apparatus according to the fourth embodiment, and illustrates each function of the control unit 3C that is a function of the display control apparatus according to the fourth embodiment.
As illustrated in FIG. 16, the control unit 3C includes a labeling information acquisition unit 30, a timing determination unit 31a, a display information generation unit 32, and an output control unit 33 as functions for controlling the display of the HUD device 4A. In FIG. 16, the same components as those in FIG.

The timing determination unit 31a determines that the timing when the road marking information related to route guidance and the vehicle are in a predetermined range is the timing of voice guidance.
The predetermined range is a range determined in terms of distance or time in which the road marking information ahead of the vehicle can be visually recognized from the driver. For example, a range of about 30 m from the own vehicle is conceivable.

Next, the operation will be described.
FIG. 17 is a flowchart showing a detailed operation of the display control apparatus according to the fourth embodiment.
In FIG. 17, the processing from step ST1a to step ST7a and from step ST8a to step ST10a is the same as the processing from step ST1a to step ST7a and from step ST8a to step ST10a shown in FIG.

Further, the processing from step ST1a to step ST6a in FIG. 17 is an example of detailed processing of step ST1 shown in FIG. The process of step ST7b is an example of the detailed process of step ST2 shown in FIG. 4, and the process of step ST8a is an example of the detailed process of step ST3 shown in FIG. The processing from step ST9a to step ST10a is an example of detailed processing of step ST4 shown in FIG.

In step ST7b, the timing determination unit 31a compares the current position of the host vehicle input from the information acquisition unit 2 with the position of the road marking information related to the route guidance ahead of the host vehicle. It is determined whether or not the distance to the position is within a predetermined range.
That is, it is determined whether or not the distance has reached a distance where the road marking information can be recognized.
If it is determined that the distance is not such that the road marking information can be recognized (step ST7b; NO), the process of step ST7b is repeated until this distance is reached.
Further, when it is determined that the distance has become such that the road marking information can be recognized (step ST7b; YES), the process proceeds to step ST8a.

As described above, in the display control apparatus according to the fourth embodiment, the timing determination unit 31a determines the timing at which the distance between the road marking information related to the route guidance and the own vehicle is within a predetermined range. It is determined that it is timing. Thus, at the timing when the driver can actually see the road marking information, it is possible to output voice guidance and display display information corresponding to the route guidance.

Embodiment 5 FIG.
FIG. 18 is a block diagram illustrating a functional configuration of the display control apparatus according to the fifth embodiment, and illustrates each function of the control unit 3D that is a function of the display control apparatus according to the fifth embodiment.
As illustrated in FIG. 18, the control unit 3D functions as a display control of the HUD device 4A as a sign information acquisition unit 30c, a timing determination unit 31, a display information generation unit 32, an output control unit 33c, and an audio information generation unit 34. Is provided. In FIG. 18, the same components as those in FIG.

The marking information acquisition unit 30c operates in the same manner as in the first embodiment, and acquires road marking information that is not included in the content of voice guidance among road marking information related to route guidance.
For example, if the content of the voice guidance is “right direction” and the road marking information related to the route guidance is in the direction of “Sannomiya” and the right direction, the direction of “Sannomiya” It is extracted as road marking information not included in the content.

The voice information generation unit 34 generates voice information for voice-outputting road marking information not included in the voice guidance content among road marking information related to the route guidance, and adds the voice information to the voice guidance.
The output control unit 33c causes the voice output device 4B to output the voice guidance to which the voice information is added by the voice information generation unit 34 in synchronization with the voice guidance timing.

Next, the operation will be described.
FIG. 19 is a flowchart showing a detailed operation of the display control apparatus according to the fifth embodiment.
In FIG. 19, the processing from step ST1a to step ST6a, step ST7a to step ST8a, and step ST10a is the same as the processing from step ST1a to step ST6a, step ST7a to step ST8a, and step ST10a shown in FIG. Omitted.

Further, the processing from step ST1a to step ST6b-2 in FIG. 19 is an example of detailed processing of step ST1 shown in FIG. The process of step ST7a is an example of the detailed process of step ST2 shown in FIG. 4, and the process of step ST8a is an example of the detailed process of step ST3 shown in FIG. The processing from step ST9d to step ST10a is an example of detailed processing of step ST4 shown in FIG.
Therefore, since the operation of each step in FIG. 4 becomes clear by explaining each step in FIG. 19, the operation will be described below with reference to FIG. 19.

The sign information acquisition unit 30c determines whether there is road sign information that is not included in the voice guidance content among the road sign information related to the route guidance (step ST6b-1). That is, the marking information acquisition unit 30c compares the road marking information related to the route guidance with the content of the voice guidance indicated by the route guidance information, and identifies the road marking information that is not included in the content of the voice guidance.

If there is no road marking information not included in the content of the voice guidance (step ST6b-1; NO), the process proceeds to step ST7a.
When there is road marking information not included in the voice guidance content (step ST6b-1; YES), the marking information acquisition unit 30c voices road marking information not included in the voice guidance content among the road marking information related to the route guidance. The data is output to the information generation unit 34.

The voice information generation unit 34 converts the road marking information that is not included in the voice guidance content input from the marking information acquisition unit 30c into voice and adds it to the voice guidance content (step ST6b-2).
For example, when the content of the voice guidance is “right direction” and the road marking information related to the route guidance is in the direction of “Sannomiya” and the right direction of the guidance sign, the voice information “Sannomiya direction” is generated, “To Sannomiya, right direction” is added to the voice guidance.

In step ST9d, the output control unit 33c causes the voice output device 4B to output the guidance voice to which the voice information is added. In synchronization with this timing, the output control unit 33c outputs the display information generated by the display information generation unit 32 to the HUD device 4A.
Thus, the display information is highlighted so as to overlap the corresponding actual road marking information in the driver's forward view.

As described above, the display control apparatus according to the fifth embodiment generates voice information for voice-outputting road marking information that is not included in the voice guidance content among the road marking information related to route guidance, and provides voice guidance. Is provided with a voice information generating unit 34 to be added. The output control unit 33c causes the voice output device 4B to output voice guidance after adding voice information in synchronization with the timing of voice guidance.
Information that is not included in the map database as in the case where a guidance sign is newly added by voice-outputting information that was not in voice guidance among road marking information detected in front of the vehicle in this way Can be interpolated by voice guidance. As a result, voice guidance in accordance with actual road conditions is possible.

In the present invention, within the scope of the invention, any combination of each embodiment, any component of each embodiment can be modified, or any component can be omitted in each embodiment. .

The display control device according to the present invention is suitable for a display control device of an in-vehicle navigation device, for example, because the display information related to route guidance can be displayed at a timing that makes it easy to see and recognize the information content.

1 navigation device, 2 information acquisition unit, 3 control unit, 3A-3D control unit, 4 notification unit, 4A HUD device, 4B audio output device, 4a navigation display unit, 4b HUD display unit, 4c display control unit, 4d audio output Part, 4e voice control part, 5 input part, 6 map data storage part, 7 route calculation part, 8 route guidance part, 9 guidance sign, 9a, 10a display information, 9b-9f additional display information, 9g display information for mask, 10 right turn arrow, 11 straight arrow, 11a display information for mask, 20 current position detection unit, 20a GPS reception unit, 20b direction detection unit, 20c pulse detection unit, 21 wireless communication unit, 22 ambient information detection unit, 23 external sensor, 23a camera, 23b image processing unit, 23c radar, 23d radar control unit, 30, 30a to 30c Marking information acquisition unit, 31, 31a timing determination unit, 32, 32a, 32b display information generation unit, 33, 33a-33c output control unit, 34 audio information generation unit, 100 processing circuit, 101 display, 102 speaker, 103 CPU, 104 memory.

Claims (7)

1. A sign information acquisition unit for acquiring road sign information related to route guidance from road sign information detected in front of the vehicle;
   A timing determination unit that determines whether it is the timing of voice guidance in route guidance;
   A display information generation unit that generates display information for highlighting the road marking information acquired by the marking information acquisition unit so as to overlap the corresponding real road display information in the forward view;
   A display control device comprising: an output control unit that outputs the display information to a display device in synchronization with the voice guidance timing determined by the timing determination unit.
2. The display information generation unit generates display information for highlighting road marking information related to the content of voice guidance so that the road marking information is superimposed on the corresponding real road display information in the forward field of view. The display control apparatus according to claim 1.
3. The display information generation unit displays the content of the route guidance that does not exist in the road marking information related to the route guidance in at least one of the corresponding empty space of the actual sign object in the front view and the position adjacent to the sign object. The display control device according to claim 1, wherein additional display information for displaying the images so as to be seen in a superimposed manner is generated.
4. The display control apparatus according to claim 1, wherein the display information generation unit generates mask display information for mask-displaying road marking information not related to route guidance for a forward view.
5. The display according to claim 1, wherein the timing determination unit determines that the timing when the distance between the road marking information related to the route guidance and the vehicle is in a predetermined range is the timing of voice guidance. Control device.
6. Among the road marking information related to the route guidance, a voice information generation unit that generates voice information for voice-outputting road marking information not included in the contents of the voice guidance and adds the voice information to the voice guidance,
   The display control device according to claim 1, wherein the output control unit causes the voice output device to output the voice guidance after adding the voice information in synchronization with a voice guidance timing.
7. A route calculator for calculating a route to the destination;
   A route guidance unit for guiding the route calculated by the route calculation unit;
   A sign information acquisition unit that acquires road sign information related to route guidance performed by the route guide unit from road sign information detected in front of the vehicle;
   A timing determination unit that determines whether it is a voice guidance timing by the route guidance unit;
   A display information generation unit that generates display information for highlighting the road marking information acquired by the marking information acquisition unit so that the road marking information is displayed so as to overlap the corresponding real road display information in the forward view; ,
   A navigation device comprising: an output control unit that outputs the display information to a display device in synchronization with the timing of voice guidance determined by the timing determination unit.

Images