JPWO2017029761A1 - Display control device, display device, and route guidance method - Google Patents

Abstract

The virtual image display unit 2 displays a display object, which is a virtual image that can be visually recognized from the driver's seat of the vehicle through a windshield, a virtual image direction that is a virtual image direction based on a specific position of the vehicle, and a virtual image that is a distance to the virtual image. It can be displayed at a virtual image position defined by the distance. The display control device 1 acquires, from the vehicle navigation device 3, a guidance information acquisition unit 11 that acquires guidance information that is route guidance information corresponding to a guidance point ahead of the vehicle, and a relative position of the guidance point with respect to the vehicle. A guidance point position acquisition unit 12 and a control unit 14 that controls display of the virtual image display unit are provided. The control unit 14 displays a guidance information display object that is a display object indicating the content of the guidance information, and also displays a guidance point display object that is a display object indicating the position of the guidance point.

Description

  The present invention relates to a display control device for controlling a display unit and a display control method using the display unit.

  Various techniques have been proposed for a head-up display (HUD) that displays an image on a windshield of a vehicle. For example, there has been proposed a HUD that displays an image as a virtual image that looks as if it is actually present in a real landscape in front of the vehicle when viewed from the driver. For example, Patent Document 1 discloses a HUD that displays guidance information (such as an arrow indicating a right / left turn direction) indicating the content of route guidance performed by a navigation device as a virtual image.

JP2015-31700A

  According to the above prior art, guidance information can be displayed at a position that is easy for the driver to see. For example, when intersections are continuous at short intervals, it is difficult to determine which intersection the guidance information corresponds to. The driver may be wondering which intersection to turn.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a technology that allows a driver to easily recognize a guidance point corresponding to guidance information provided by a navigation device.

  A display control device according to a first aspect of the present invention is a display control device that controls a virtual image display unit, and the virtual image display unit is a virtual image that is visible from the driver's seat of the vehicle through the windshield of the vehicle. The display object can be displayed at a virtual image position defined by a virtual image direction that is a direction of the virtual image with respect to a specific position of the vehicle and a virtual image distance that is a distance to the virtual image. Control that controls the display of the guidance information acquisition unit that acquires the guidance information that is the route guidance information corresponding to the guidance point ahead, the guidance point position acquisition unit that acquires the relative position of the guidance point with respect to the vehicle, and the display of the virtual image display unit The control unit is a display object that displays a guide information display object that is a display object indicating the content of the guide information and that indicates the position of the guide point. To view the internal point display object.

  A display control device according to a second aspect of the present invention is a display control device that controls an image display unit, a shadow image acquisition unit that acquires a forward image that is a shadow image of the front of the vehicle, and a vehicle navigation device. A guidance information acquisition unit that acquires guidance information that is route guidance information corresponding to a guidance point ahead of the vehicle, a guidance point position acquisition unit that acquires the position of the guidance point in the front image, and a display of the image display unit The control unit displays a guidance information display object, which is an image showing the content of the guidance information, on the image display unit, and a guidance point display which is an image showing the position of the guidance point in the forward image The object is superimposed on the front image and displayed on the image display unit.

  According to the present invention, when the navigation device performs route guidance, the guidance point display object indicating the position of the guidance point is displayed together with the guidance information display object indicating the content of the guidance information. The corresponding guide point can be easily grasped.

  The objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description and the accompanying drawings.

1 is a block diagram illustrating a configuration of a display control device according to a first embodiment. It is a figure for demonstrating the virtual image (display object) which a virtual image display part displays. It is a figure for demonstrating the display object which a virtual image display part displays. It is a figure for demonstrating the display object which a virtual image display part displays. It is a figure for demonstrating the display object which a virtual image display part displays. 3 is a flowchart showing an operation of the display control apparatus according to the first embodiment. It is a figure which shows the example of the positional relationship of the own vehicle and a guidance point. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. 3 is a diagram illustrating an example of a hardware configuration of a display control device according to Embodiment 1. FIG. 3 is a diagram illustrating an example of a hardware configuration of a display control device according to Embodiment 1. FIG. 6 is a block diagram illustrating a configuration of a display control device according to Embodiment 2. FIG. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. 10 is a flowchart illustrating an operation of the display control apparatus according to the second embodiment. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure for demonstrating the virtual image display part which can change a virtual image distance. It is a figure which shows the example of a display of the display object from which a virtual image distance differs. FIG. 10 is a block diagram illustrating a configuration of a display control device according to a fourth embodiment. 10 is a flowchart showing the operation of the display control apparatus according to the fourth embodiment. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. FIG. 10 is a block diagram illustrating a configuration of a display control device according to a fifth embodiment. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. 10 is a flowchart illustrating an operation of the display control apparatus according to the fifth embodiment. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object. It is a figure which shows the example of a display of a guidance information display object and a guidance point display object.

<Embodiment 1>
FIG. 1 is a diagram showing a configuration of a display control apparatus 1 according to Embodiment 1 of the present invention. In the present embodiment, the display control device 1 will be described as being mounted on a vehicle. A vehicle equipped with the display control device 1 is referred to as “own vehicle”.

  The display control device 1 controls the virtual image display unit 2 that displays an image as a virtual image in the driver's field of view, such as HUD. In addition, the navigation device 3 of the host vehicle is connected to the display control device 1. Although an example in which the virtual image display unit 2 is externally connected to the display control device 1 is shown here, the virtual image display unit 2 may be configured integrally with the display control device 1. That is, the display control device 1 and the virtual image display unit 2 may be configured as one display device.

  With reference to FIG. 2 and FIG. 3, the virtual image which the virtual image display part 2 displays is demonstrated. In this specification, the virtual image displayed by the virtual image display unit 2 is referred to as a “display object”. As shown in FIG. 2, the virtual image display unit 2 can display the display object 100 at a position that can be viewed through the windshield 201 from the position of the driver 200 of the host vehicle. The position where the display object 100 is actually displayed is on the windshield 201, but when viewed from the driver 200, the display object 100 appears as if it exists in the landscape in front of the vehicle. ing.

  In this specification, the apparent display position of the display object 100 viewed from the driver 200 is referred to as a “virtual image position”. The virtual image position is defined by the “virtual image direction” that is the direction of the display object 100 based on the position of the driver 200 and the “virtual image distance” that is the apparent distance from the position of the driver 200 to the display object 100. Is done. As described above, the reference point for defining the virtual image position is preferably the position of the driver 200, but may be any specific position of the vehicle that can be regarded as the position of the driver 200. Or the windshield 201 may be used as a reference point.

The virtual image direction substantially corresponds to the position of the display object 100 on the windshield 201 as viewed from the driver 200, and is, for example, a deviation angle (θ _i , φ _i ) of a three-dimensional polar coordinate system as shown in FIG. expressed. Virtual image distance is substantially equivalent to the apparent distance to the display object 100 as viewed from the driver 200, for example, three-dimensional polar coordinate system radius vector as shown in FIG. 3 (r _i) are represented by like. The driver 200 adjusts the focus (focus) distance Fd of his / her eyes to the virtual image distance (r _i ) to display a display object at a virtual image position represented by three-dimensional polar coordinates (r _i , θ _i , φ _i ). 100 can be visually recognized.

Incidentally, equal surfaces of the virtual image distance (r _i) Expressing virtual image position in three dimensions polar coordinates becomes spherical, a virtual image direction as a virtual image display unit 2 of the vehicle is limited to a certain range (forward direction of the vehicle) In this case, a plane having the same virtual image distance may be approximated by a plane. Also, many HUDs are optically devised so that the virtual image display surface is flat. In the following description, in fact that (Figure 4 dealing with equal surface of the virtual image distance as a plane as shown in FIG. 4, the traveling direction of the vehicle is y-axis, the display surface of y = r _i plane virtual image distance r _i of As stipulated).

  Returning to FIG. 1, the navigation device 3 searches for an optimum route from the current position of the host vehicle to the destination, determines that route as a scheduled travel route, and operates so that the host vehicle travels along the planned travel route. Route guidance to the user. The route guidance performed by the navigation device 3 is performed by instructing the driver of the traveling direction of the host vehicle when the host vehicle approaches a branch point or an intersection on the travel route. A point where the navigation apparatus 3 performs route guidance is referred to as a “guidance point”, and information indicating the content of the route guidance (such as an instruction of a traveling direction) is referred to as “guidance information”. The guide points may be junctions (intersections of expressways, etc.), lane change points, and the like in addition to junctions and intersections.

  As shown in FIG. 1, the display control device 1 includes a guidance information acquisition unit 11, a guidance point position acquisition unit 12, a display object storage unit 13, and a control unit 14.

  The guidance information acquisition unit 11 acquires, from the navigation device 3, guidance information indicating the content of route guidance at a guidance point ahead of the host vehicle (next guidance point). In the present embodiment, the navigation device 3 outputs guidance information corresponding to the guidance point to the guidance information acquisition unit 11 when approaching the guidance point of the host vehicle. “When approaching the guide point of the host vehicle” may be defined as, for example, a case where the distance from the host vehicle to the guide point becomes smaller than a predetermined threshold. It may be defined as a case where the expected time until arrival becomes smaller than a predetermined threshold.

  The guide point position acquisition unit 12 acquires the relative position of the guide point corresponding to the guide information acquired by the guide information acquisition unit 11 with respect to the host vehicle. The relative position of the guide point with respect to the host vehicle can be calculated from the position information of the guide point included in the map information stored in the navigation device 3 and the position information of the host vehicle acquired by the navigation device 3. In the present embodiment, it is assumed that the navigation device 3 calculates the relative position of the guide point, and the guide point position acquisition unit 12 acquires the calculation result. Or the guidance point position acquisition part 12 may acquire the positional information on a guidance point and the own vehicle from the navigation apparatus 3, and may calculate the relative position of a guidance point from the information.

  The display object storage unit 13 stores image data of a plurality of display objects in advance. The display object stored in the display object storage unit 13 includes an image for indicating the content of the guidance information (for example, an arrow graphic indicating a right turn or a left turn) and an image for indicating the position of the guidance point ( Specific examples will be described later).

  The control unit 14 comprehensively controls each component of the display control device 1 and controls display of a virtual image by the virtual image display unit 2. For example, the control unit 14 can display the display object stored in the display object storage unit 13 in the visual field of the driver 200 using the virtual image display unit 2. Further, the control unit 14 can control the virtual image position of the display object displayed by the virtual image display unit 2. As described above, the virtual image position is represented by the virtual image direction and the virtual image distance. In this embodiment, it is assumed that the virtual image display unit 2 does not have a function of changing the virtual image distance of the display object. The virtual image distance is assumed to be constant. The control unit 14 may have a function of generating a display object that is not stored in the display object storage unit 13, or may have a function of deforming the display object.

For example, when the virtual image distance of the display object displayed by the virtual image display unit 2 is 30 m ( _ri = 30 m in FIG. 4), the control unit 14 displays the display object 100 with the virtual image distance of 30 m on the virtual image display unit 2. Can be made. In that case, it appears to the driver that the display object 100 exists 30 m ahead through the windshield 201 as shown in FIG. 5 (the element 202 is the handle of the host vehicle).

  Next, the operation of the display control apparatus 1 according to the first embodiment will be described. FIG. 6 is a flowchart showing the operation. When the display control device 1 obtains the guidance information corresponding to the guidance point ahead of the host vehicle from the navigation device 3, the display control device 1 displays a display object indicating the content of the guidance information and the position of the guidance point corresponding to the guidance information. Operates to display the displayed display object. Hereinafter, the display object indicating the content of the guidance information is referred to as “guidance information display object”, and the display object indicating the position of the guidance point is referred to as “guidance point display object”.

  When the host vehicle approaches the front guide point, the guide information acquisition unit 11 acquires guide information corresponding to the guide point from the navigation device 3 (step S11). Moreover, the guidance point position acquisition part 12 acquires the relative position with respect to the own vehicle of the said guidance point (step S12).

  Thereafter, the control unit 14 acquires data of a guidance information display object (for example, a graphic of an arrow indicating a right turn or a left turn) from the display object storage unit 13 and displays it using the virtual image display unit 2 (step S13). . The virtual image position of the guidance information display object may be an arbitrary position as long as it is easy for the driver to see. For example, the virtual image position of the guidance information display object may be fixed at a certain position of the windshield, or may be a position that is visible in the vicinity of the guidance point when viewed from the driver (for example, above the guidance point). Good.

  Furthermore, the control part 14 acquires the data of a guidance point display object from the display object memory | storage part 13, and displays it on the position corresponding to a guidance point seeing from a driver | operator (step S14). The display control device 1 repeatedly executes the above operation.

  For example, as shown in FIG. 7, consider a case where an intersection XP1 located in front of the host vehicle S is a guidance point, and an intersection XP2 that is not a guidance point exists in front of the intersection XP1. Further, it is assumed that the content of the guidance information corresponding to the intersection XP1 is “right turn”.

  In this case, the driver's field of view through the windshield 201 displays a guidance information display object 31 (arrow figure) indicating a right turn as shown in FIG. 8, and corresponds to the intersection XP1 as viewed from the driver. A guidance point display object 32 indicating the guidance point is displayed at the position to be played. In the present embodiment, the guide point display object 32 is a virtual image of a nonexistent object that appears to be present at the guide point when viewed from the driver. FIG. 8 is an example in which the guide point display object 32 is a virtual image of a pole.

  The guide point display object 32 is not limited to the virtual image of the pole. For example, as shown in FIG. 9, a virtual image of a nonexistent wall that appears at the guide point (XP1) when viewed from the driver may be used as the guide point display object 32. . For example, as shown in FIG. 10, a virtual image in which a road ahead of the guide point (XP1) when viewed from the driver is colored may be used as the guide point display object 32.

  According to the present embodiment, the guidance point display object 32 is displayed at a position corresponding to the intersection XP1 when viewed from the driver, so that the driver can obtain guidance information (instructed to turn right) indicated by the guidance information display object 31. ) Can be easily recognized as the intersection XP1.

  FIG. 11 and FIG. 12 are diagrams each illustrating an example of a hardware configuration of the display control device 1. The guidance information acquisition unit 11, the guidance point position acquisition unit 12, and the control unit 14 in the display control device 1 are realized by, for example, a processing circuit 40 illustrated in FIG. That is, the processing circuit 40 includes a guidance information acquisition unit 11 that acquires guidance information corresponding to a guidance point ahead of the host vehicle from the navigation device 3, and a guidance point position acquisition unit that acquires a relative position of the guide point with respect to the host vehicle. 12 and a control unit 14 for displaying a guidance information display object 31 indicating the content of the guidance information and displaying a guidance point display object 32 indicating the position of the guidance point. Dedicated hardware may be applied to the processing circuit 40, or a processor (Central Processing Unit, central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, Digital, which executes a program stored in the memory Signal Processor) may be applied.

  When the processing circuit 40 is dedicated hardware, the processing circuit 40 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a processor programmed in parallel, an ASIC, an FPGA, or a combination thereof. . The functions of each part of the guidance information acquisition unit 11, the guidance point position acquisition unit 12, and the control unit 14 may be realized by a plurality of processing circuits 40, or the functions of the respective units are realized by a single processing circuit 40. May be.

  FIG. 12 shows a hardware configuration of the display control apparatus 1 when the processing circuit 40 is a processor. In this case, the functions of the guidance information acquisition unit 11, the guidance point position acquisition unit 12, and the control unit 14 are realized by a combination with software or the like (software, firmware, or software and firmware). Software or the like is described as a program and stored in the memory 42. The processor 41 as the processing circuit 40 implements the functions of the respective units by reading and executing the program stored in the memory 42. That is, when executed by the processing circuit 40, the display control device 1 acquires the guidance information corresponding to the guidance point ahead of the host vehicle from the navigation device 3, and the relative position of the guide point with respect to the host vehicle. As a result, the step of acquiring and the step of displaying the guidance information display object 31 indicating the content of the guidance information and displaying the guidance point display object 32 indicating the position of the guidance point are executed as a result. A memory 42 for storing the program is provided. In other words, this program can be said to cause the computer to execute the procedures and methods of the guidance information acquisition unit 11, the guidance point position acquisition unit 12, and the control unit 14. Here, the memory 42 is non-volatile such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), and the like. Or a volatile semiconductor memory, HDD (Hard Disk Drive), a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, DVD (Digital Versatile Disc), its drive device, etc. correspond.

  The configuration in which the functions of the guidance information acquisition unit 11, the guidance point position acquisition unit 12, and the control unit 14 are realized with either hardware or software has been described above. However, the present invention is not limited to this, and a part of the guide information acquisition unit 11, the guide point position acquisition unit 12, and the control unit 14 is realized by dedicated hardware, and another part is realized by software or the like. May be. For example, the function of the control unit 14 is realized by a processing circuit as dedicated hardware, and for the other parts, the processing circuit 40 as the processor 41 reads the program stored in the memory 42 and executes it to execute the function. Can be realized.

  As described above, the processing circuit 40 can realize the functions described above by hardware, software, or the like, or a combination thereof. The display object storage unit 13 is configured by the memory 42, but may be configured by one memory 42 or a plurality of memories 42.

  The display control device described above includes an installed navigation device that can be mounted on a vehicle, a portable navigation device, a communication terminal (for example, a mobile terminal such as a mobile phone, a smartphone, and a tablet), and an application that is installed on these devices. It is possible to apply to a display control system constructed as a system by appropriately combining these functions and a server. In this case, each function or each component of the display control device described above may be distributed and arranged in each device constituting the system, or may be concentrated on any device. .

<Embodiment 2>
FIG. 13 is a block diagram illustrating a configuration of the display control apparatus 1 according to the second embodiment. In the second embodiment, the display control apparatus 1 is further connected with a moving body detection unit 4 that detects a moving body (a vehicle, a motorcycle, etc.) that exists in front of the host vehicle. The moving body detection unit 4 can detect the presence of the moving body using, for example, a millimeter wave radar of the own vehicle, a DSRC (Dedicate Short Range Communication) unit, a camera (for example, an infrared camera), or the like.

  Further, the display control apparatus 1 has a configuration in which a moving body position acquisition unit 15 is added to the configuration of FIG. The moving body position acquisition unit 15 acquires the relative position of the moving body detected by the moving body detection unit 4 with respect to the guide point. The relative position between the guide point and the moving body is information on the relative position of the guide point with respect to the host vehicle acquired by the guide point position acquiring unit 12, the output data of the millimeter wave radar of the host vehicle, the output data of the DSRC unit, or It can be calculated from information on the position of the moving body (relative position with respect to the host vehicle) obtained from the analysis result of the video captured by the camera.

  Note that the display control apparatus 1 of the second embodiment is also realized by the hardware configuration shown in FIG. 11 or FIG. That is, the function of the moving body position acquisition unit 15 is also realized by the processing circuit 40 or the processor 41 that executes a program.

  Here, as shown in FIG. 7, a case is considered in which an intersection XP1 located in front of the host vehicle S is a guide point, and an intersection XP2 that is not a guide point exists in front of the intersection XP1. The content of the guidance information corresponding to the intersection XP1 is “turn right”.

  In the second embodiment, the guide point display object 32 does not directly indicate the position of the guide point, but indirectly by attaching the guide point display object 32 to each mobile body existing around the guide point. The position of the guide point is indicated. As shown in FIG. 14, the guide point display object 32 includes a first display object 32 a (mark “◯”) indicating a moving body (vehicles 51, 52) located closer to the guide point, and a guide point. And a second display object 32b ("x" mark) indicating a moving body (vehicle 53) located further away. Therefore, it can be seen that a guide point exists at a position between the vehicles 51 and 52 to which the first display object 32a is attached and the vehicle 53 to which the second display object 32b is attached. Therefore, the same effect as in the first embodiment can be obtained. This embodiment is effective when it is difficult for the driver to visually recognize the guide point due to the presence of a moving body in front of the host vehicle.

  An operation of the display control apparatus 1 according to the second embodiment will be described. FIG. 15 is a flowchart showing the operation.

  When the host vehicle approaches the guidance point ahead, the guidance information acquisition unit 11 acquires guidance information corresponding to the guidance point from the navigation device 3 (step S21). Moreover, the guidance point position acquisition part 12 acquires the relative position with respect to the own vehicle of the said guidance point (step S22).

  Then, the control part 14 acquires the data of a guidance information display object from the display object memory | storage part 13, and displays it using the virtual image display part 2 (step S23). The virtual image position of the guidance information display object may be an arbitrary position as long as it is easy for the driver to see.

  Next, the moving body position acquisition part 15 confirms whether the moving body ahead of the own vehicle is detected by the moving body detection part 4 (step S24). At this time, if a moving body is detected (YES in step S24), the moving body position acquisition unit 15 acquires the relative position of each moving body with respect to the guide point in front of the host vehicle (step S25). And the control part 14 is a guidance point display object (a 1st display object or a 2nd display object) according to the relative position with respect to the guidance point of the mobile body in the position corresponding to each mobile body seeing from a driver | operator. Is displayed (step S26).

  In addition, if the moving body is not detected by the moving body detection part 4 (it is NO at step S24), said step S25, S26 will not be performed. The display control device 1 repeatedly executes the above operation.

  As described above, in the second embodiment, the guide point display object 32 is attached to each moving body according to the relative position of the moving body with respect to the guide point. The example of the guidance point display object 32 is not limited to that shown in FIG. 14, but for example, as shown in FIG. You may make it attach | subject the guidance point display object 32 (mark of "(circle)"). In this case, the driver can grasp not only the position of the guidance point but also the traveling direction of the host vehicle at the guidance point.

  In the example of FIG. 16, a virtual image of the guidance information display object 31 may be used as the guidance point display object 32. That is, as shown in FIG. 17, a virtual image (indicating a right turn) of the guidance information display object 31 is displayed as the guidance point display object 32 on a vehicle 54 traveling in a direction that matches the content of guidance information (right turn) from the guidance point (intersection XP1). An arrow) may be attached.

  In the flow of FIG. 15, when a moving body is not detected by the moving body detection unit 4 (NO in step S24), there is no target to which the guidance point display object 32 is attached, so the guidance point display object 32 is displayed. Not. However, even in such a case, the guide point display object 32 may be displayed.

  For example, as shown in FIG. 18, the display control device 1 uses, as a guide point display object 32, virtual images 51v, 52v, 53v of non-existent vehicles that appear to exist around an intersection XP1 (guide point), and an intersection XP1. The first display object 32a showing the virtual images 51v and 52v of the vehicle appearing close to each other and the second display object 32b showing the virtual image 53v of the vehicle appearing farther than the intersection XP1 are displayed. It may be. Thereby, even when there is no moving body in front of the host vehicle, the same effect as in the case of FIG. 14 can be obtained.

  Further, as shown in FIG. 19, the display control device 1 has a virtual image 54v of a non-existent vehicle that appears as a guidance point display object 32 in a direction that coincides with the content (right turn) of guidance information from the intersection XP1 (guidance point). A display object (mark “◯”) indicating the virtual image 54v of the vehicle may be displayed. Thereby, even when there is no moving body in front of the host vehicle, the same effect as in the case of FIG. 16 can be obtained. In the example of FIG. 19, as described with reference to FIG. 17, the virtual image of the guidance information display object 31 may be used as the guidance point display object 32.

<Embodiment 3>
In the first and second embodiments, the virtual image display unit 2 has been described as not having the function of changing the virtual image distance, but the virtual image display unit 2 may have the function. For example, it is assumed that the virtual image display unit 2 can select and set the virtual image distance of the display object from 25 m, 50 m, and 75 m. In this case, as shown in FIG. 20, the control unit 14 includes a first display object 101a having a virtual image distance of 25 m, a second display object 101b having a virtual image distance of 50 m, and a third display object having a virtual image distance of 75 m. 101 c can be displayed on the virtual image display unit 2. In this case, as shown in FIG. 21, the driver displays the first display object 101a 25 m ahead, the second display object 101b 50 m ahead, and the third 75 m ahead through the windshield 201. It appears that the display object 101c exists (the element 202 is the handle of the host vehicle).

  For example, in the example of FIGS. 8 and 9, if the virtual image distance of the guidance point display object 32 is made equal to the distance from the host vehicle to the intersection XP1, the real feeling that the guidance point display object 32 appears to exist at the intersection XP1. Increase.

  Further, in the example of FIG. 14, the virtual image distance of the first display object 32a (mark “◯”) attached to the moving body (vehicles 51, 52) located closer to the intersection XP1 is determined from the own vehicle to the intersection XP1. And the virtual image distance of the second display object 32b ("x" mark) attached to the moving body (vehicle 53) located farther than the intersection XP1 from the host vehicle to the intersection XP1. It may be longer than the distance. Furthermore, the virtual image distance of the first display object 32 a attached to the vehicle 51 is made equal to the distance from the own vehicle to the vehicle 51, and the virtual image distance of the first display object 32 a attached to the vehicle 52 is changed from the own vehicle to the vehicle 52. The virtual image distance of the second display object 32b attached to the vehicle 53 may be equal to the distance from the host vehicle to the vehicle 53. Similarly, in the example of FIG. 16 or FIG. 17, the virtual image distance of the guide point display object 32 attached to the vehicle 54 may be equal to the distance from the host vehicle to the vehicle 54.

  Further, in the example of FIG. 18, the virtual image distance of the moving object (virtual images 51v and 52v) that appears to be located closer to the intersection XP1 and the virtual image distance of the first display object 32a (mark “◯”) attached thereto are calculated as follows. A virtual image (virtual image 53v) of a moving body that is shorter than the distance from the vehicle to the intersection XP1 and is located farther than the intersection XP1, and a virtual image of the second display object 32b (mark “x”) attached thereto. The distance may be longer than the distance from the host vehicle to the intersection XP1. In the example of FIG. 19, the virtual image 54v of the moving body that appears to proceed from the intersection XP1 (guide point) to the content (right turn) of the guidance information and the virtual image distance of the display object (mark “◯”) attached thereto. May be equal to the distance from the host vehicle to the intersection XP1.

<Embodiment 4>
FIG. 22 is a diagram showing a configuration of the display control apparatus 1 according to Embodiment 4 of the present invention. The display control device 1 according to the fourth embodiment controls an image display unit 5 that displays an image on a screen, such as a liquid crystal display device. In addition, the navigation device 3 of the host vehicle is connected to the display control device 1. Although an example in which the image display unit 5 is externally connected to the display control device 1 is shown here, the image display unit 5 may be configured integrally with the display control device 1. That is, the display control device 1 and the image display unit 5 may be configured as one display device.

  The display control device 1 is connected to an in-vehicle camera 6 that captures a forward image of the host vehicle (hereinafter referred to as a “front image”). The display control device 1 captures a forward image captured by the in-vehicle camera 6. An image acquisition unit 16 for acquisition is provided. Further, the guide point position acquisition unit 12 operates to acquire the position of the guide point in the front image by image analysis processing. Since the other elements in FIG. 22 are the same as those shown in FIG. 1, the description thereof is omitted here.

  Note that the display control device 1 according to the fourth embodiment is also realized by the hardware configuration shown in FIG. 11 or FIG. That is, the function of the image acquisition unit 16 is also realized by the processing circuit 40 or the processor 41 that executes a program.

  Next, the operation of the display control apparatus 1 according to Embodiment 4 will be described. FIG. 23 is a flowchart showing the operation. In the fourth embodiment, the display control device 1 displays a forward image acquired from the in-vehicle camera 6 on the image display unit 5. In addition, when the display control device 1 acquires guidance information corresponding to the guidance point (next guidance point) ahead of the host vehicle from the navigation device 3, the display control device 1 displays an image indicating the content of the guidance information on the image display unit 5. Then, an image indicating the position of the guide point corresponding to the guide information is displayed on the image display unit 5 so as to be superimposed on the front shadow image.

  Hereinafter, each image that the display control device 1 displays on the image display unit 5 together with the forward image is referred to as a “display object”. In particular, an image indicating the content of the guidance information is referred to as a “guidance information display object”, and an image indicating the position of the guidance point is referred to as a “guidance point display object”.

  While the host vehicle is traveling, the image acquisition unit 16 acquires a front image captured by the in-vehicle camera 6 (step S31), and the control unit 14 causes the image display unit 5 to display the front image (step S32). Moreover, the control part 14 confirms whether the guidance information acquisition part 11 acquired the guidance information corresponding to the guidance point (next guidance point) ahead of the own vehicle from the navigation apparatus 3 (step S33). If the guide information acquisition unit 11 has not acquired the guide information corresponding to the next guide point (NO in step S33), the process returns to step S31.

  When the guide information acquisition unit 11 acquires the guide information corresponding to the next guide point (YES in step S33), the guide point position acquisition unit 12 acquires the position of the guide point in the front image (step S34).

  Thereafter, the control unit 14 acquires data of a guidance information display object (for example, an arrow graphic representing a right turn or a left turn) from the display object storage unit 13 and displays it on the image display unit 5 (step S35). The display position of the guidance information display object may be an arbitrary position as long as it is easy for the driver to see. For example, it may be fixed at a fixed position on the screen of the image display unit 5, or may be in the vicinity of the guidance point (for example, above the guidance point) in the forward video displayed on the image display unit 5.

  Further, the control unit 14 acquires the data of the guidance point display object from the display object storage unit 13 and displays it at a position corresponding to the guidance point in the forward image displayed on the image display unit 5 (step S36). Return to S31. The display control device 1 repeatedly executes the above operation.

  Here, as shown in FIG. 7, a case is considered in which an intersection XP1 located in front of the host vehicle S is a guide point, and an intersection XP2 that is not a guide point exists in front of the intersection XP1. The content of the guidance information corresponding to the intersection XP1 is “turn right”.

  In this case, as shown in FIG. 24, a guidance information display object 31 (arrow figure) indicating a right turn is displayed on the image display unit 5, and a guidance point is indicated at a position corresponding to the intersection XP1 in the forward image. A guide point display object 32 is displayed. In the present embodiment, the guide point display object 32 is an image of a nonexistent object that appears to exist at the guide point. FIG. 24 is an example in which the guide point display object 32 is an image of a pole.

  The guide point display object 32 is not limited to a virtual image of a pole. For example, as shown in FIG. 25, a virtual image of a nonexistent wall that appears at the guide point (XP1) when viewed from the driver may be used as the guide point display object 32. . For example, as shown in FIG. 26, an image in which a road ahead of the guide point (XP1) when viewed from the driver is colored may be used as the guide point display object 32.

  According to the present embodiment, the guidance point display object 32 is displayed at a position corresponding to the intersection XP1 in the forward image displayed on the image display unit 5. Accordingly, the driver can easily recognize that the guidance point corresponding to the right turn instruction represented by the guidance information display object 31 is the intersection XP1 by looking at the image display unit 5.

  Note that the display control apparatus 1 according to the fourth embodiment can also be realized by the hardware configuration shown in FIG. 11 or FIG. For example, in the case of a hardware configuration as shown in FIG. 11, the processing circuit 40 includes the guidance information acquisition unit 11 that acquires guidance information corresponding to the guidance point ahead of the host vehicle from the navigation device 3, and the position of the guidance point in the front image. And a guidance information display object 31 indicating the content of the guidance information is displayed on the image display unit 5 and a guidance point display object 32 indicating the position of the guidance point in the forward image is displayed in the forward image. And a control unit 14 that displays the image on the image display unit 5.

  In the case of a hardware configuration as shown in FIG. 12, the processor 41 reads out and executes a program stored in the memory 42, thereby acquiring guidance information corresponding to a guidance point ahead of the host vehicle from the navigation device 3. A step of acquiring a position of the guide point in the front image, a guide information display object 31 indicating the content of the guide information is displayed on the image display unit 5, and a guide point display indicating the position of the guide point in the front image As a result, the step of superimposing the object 32 on the front image and displaying it on the image display unit 5 is executed.

  In addition, the display control device according to the present embodiment is also installed in a navigation device, a portable navigation device, a communication terminal (for example, a mobile terminal such as a mobile phone, a smartphone, and a tablet) that can be mounted on a vehicle. The present invention can be applied to a display control system constructed as a system by appropriately combining application functions and servers. In this case, each function or each component of the display control device described above may be distributed and arranged in each device constituting the system, or may be concentrated on any device. .

<Embodiment 5>
FIG. 27 is a block diagram illustrating a configuration of the display control apparatus 1 according to the fifth embodiment. The display control apparatus 1 according to the fifth embodiment is further connected to a moving body detection unit 4 that detects a moving body (vehicle, motorcycle, etc.) that exists in front of the host vehicle. The moving body detection unit 4 is the same as that shown in the second embodiment (FIG. 13).

  Moreover, the display control apparatus 1 has a configuration in which a moving body position acquisition unit 15 that acquires a relative position of the moving body detected by the moving body detection unit 4 with respect to the guide point is added to the configuration of FIG. As in the second embodiment, the moving body position acquisition unit 15 acquires the relative position of the moving body detected by the moving body detection unit 4 with respect to the guide point, and performs image analysis processing to determine the position of the moving body in the front image. Works to get.

  Here, as shown in FIG. 7, a case is considered in which an intersection XP1 located in front of the host vehicle S is a guide point, and an intersection XP2 that is not a guide point exists in front of the intersection XP1. The content of the guidance information corresponding to the intersection XP1 is “turn right”.

  In the fifth embodiment, the guide point display object 32 does not directly indicate the position of the guide point, but the guide point display object 32 is attached to each mobile body existing around the guide point. The location of the guide point is shown indirectly. As shown in FIG. 28, the guide point display object 32 includes a first display object 32 a (mark “◯”) indicating a moving body (vehicles 51, 52) located closer to the guide point, and a guide point. And a second display object 32b ("x" mark) indicating a moving body (vehicle 53) located further away. Therefore, it can be seen that a guide point exists at a position between the vehicles 51 and 52 to which the first display object 32a is attached and the vehicle 53 to which the second display object 32b is attached. Therefore, the same effect as in the fourth embodiment can be obtained. This embodiment is effective when the in-vehicle camera 6 is difficult to photograph the guide point due to the presence of a moving body in front of the host vehicle.

  The operation of the display control apparatus 1 according to the fifth embodiment will be described. FIG. 29 is a flowchart showing the operation.

  The image acquisition unit 16 acquires a front image captured by the in-vehicle camera 6 (step S41), and the control unit 14 causes the image display unit 5 to display the front image (step S42). Moreover, the control part 14 confirms whether the guidance information acquisition part 11 acquired the guidance information corresponding to the guidance point (next guidance point) ahead of the own vehicle from the navigation apparatus 3 (step S43). If the guide information acquisition unit 11 has not acquired the guide information corresponding to the next guide point (NO in step S43), the process returns to step S41.

  When the guide information acquisition unit 11 acquires the guide information corresponding to the next guide point (YES in step S43), the control unit 14 acquires the data of the guide information display object from the display object storage unit 13, and displays it as an image. This is displayed on the part 5 (step S44). The display position of the guidance information display object may be an arbitrary position as long as it is easy for the driver to see.

  Next, the moving body position acquisition part 15 confirms whether the moving body ahead of the own vehicle is detected by the moving body detection part 4 (step S45). At this time, if a moving body is detected (YES in step S45), the moving body position acquisition unit 15 acquires the relative position of each moving body with respect to the guide point in front of the host vehicle (step S46). Furthermore, the moving body position acquisition part 15 acquires the position of the said moving body in a front image by image analysis processing (step S47). And the control part 14 is a position corresponding to each moving body in the front image displayed on the image display part 5, and the guidance point display object (a 1st display object or an object) according to the relative position with respect to the guidance point of the moving body. The second display object) is displayed (step S48).

  If no moving body is detected by the moving body detection unit 4 (NO in step S45), the above steps S46 to S48 are not performed. The display control device 1 repeatedly executes the above operation.

  Thus, in the fifth embodiment, the guide point display object 32 is attached to the moving body according to the relative position of the moving body with respect to the guide point. The example of the guide point display object 32 is not limited to that shown in FIG. 28. For example, as shown in FIG. 30, a vehicle 54 that travels from the guide point (intersection XP1) in the direction that matches the content of the guide information (right turn) You may make it attach | subject the guidance point display object 32 (mark of "(circle)"). In this case, the driver can grasp not only the position of the guidance point but also the traveling direction of the host vehicle at the guidance point.

  In the example of FIG. 30, the image of the guidance information display object 31 may also be used as the guidance point display object 32. That is, as shown in FIG. 31, a guidance information display object 31 (an arrow indicating a right turn) is provided as a guidance point display object 32 on a vehicle 54 that travels in a direction that coincides with the content of guidance information (right turn) from the guidance point (intersection XP1). May be attached.

  In the flow of FIG. 29, when a moving body is not detected by the moving body detection unit 4 (NO in step S24), there is no target to which the guidance point display object 32 is attached, so the guidance point display object 32 is not displayed. . However, even in such a case, the guide point display object 32 may be displayed.

  For example, as shown in FIG. 32, the display control device 1 uses the images 51i, 52i, 53i of non-existing vehicles that appear to exist around the guidance point (intersection XP1) as the guidance point display object 32, and the intersection XP1. The first display object 32a showing the vehicle images 51i and 52i that appear to be close to each other and the second display object 32b showing the vehicle image 53i that appears to be located far from the intersection XP1 are displayed. It may be. Thereby, even when there is no moving body in front of the host vehicle, the same effect as in the case of FIG. 28 can be obtained.

  Also, as shown in FIG. 33, the display control device 1 displays, as a guide point display object 32, an image 54i of a nonexistent vehicle that appears to advance in a direction that matches the content of the guide information from the intersection XP1, and an image 54i of the vehicle. You may make it display the display object (mark of "(circle)") to show. Thereby, even when there is no moving body in front of the host vehicle, the same effect as in the case of FIG. 30 can be obtained. In the example of FIG. 33, as described with reference to FIG. 31, the image of the guidance information display object 31 may also be used as the guidance point display object 32.

  It should be noted that the present invention can be freely combined with each other within the scope of the invention, and each embodiment can be appropriately modified or omitted. For example, in FIG. 1 and the like, the configuration in which the navigation device 3 is connected to the display control device 1 is shown, but the display control device 1 may be configured to include the navigation device 3 (that is, the display control device 1 is navigated to). May have a function).

  Although the present invention has been described in detail, the above description is illustrative in all aspects, and the present invention is not limited thereto. It is understood that countless variations that are not illustrated can be envisaged without departing from the scope of the present invention.

  DESCRIPTION OF SYMBOLS 1 Display control apparatus, 2 Virtual image display part, 3 Navigation apparatus, 4 Moving body detection part, 5 Image display part, 6 Car-mounted camera, 11 Guidance information acquisition part, 12 Guidance point position acquisition part, 13 Display object memory | storage part, 14 Control 15, moving body position acquisition unit, 16 image acquisition unit, 31 guidance information display object, 32 guidance point display object, 32 a first display object, 32 b second display object, 40 processing circuit, 41 processor, 42 memory, 100 display object, 200 driver, 201 windshield.

Claims (18)

A display control device for controlling a virtual image display unit,
The virtual image display unit
A virtual object that is a virtual image direction that is a direction of the virtual image with respect to a specific position of the vehicle, and a virtual image that is a distance to the virtual image, is a virtual object that is visible from the driver's seat of the vehicle through the windshield of the vehicle It can be displayed at the virtual image position defined by the distance,
A guidance information acquisition unit that acquires guidance information that is route guidance information corresponding to a guidance point ahead of the vehicle from the vehicle navigation device;
A guide point position acquisition unit for acquiring a relative position of the guide point with respect to the vehicle;
A control unit for controlling the display of the virtual image display unit,
The control unit displays a guidance information display object that is a display object indicating the content of the guidance information, and displays a guidance point display object that is a display object indicating the position of the guidance point. apparatus. A moving body position acquisition unit that acquires a relative position of the moving body existing in front of the vehicle with respect to the guide point;
The control unit, as the guide point display object, a first display object indicating a moving body located closer to the guide point and a second display object indicating a mobile body located farther than the guide point. The display control apparatus of Claim 1 which displays. A moving body position acquisition unit that acquires a relative position of the moving body existing in front of the vehicle with respect to the guide point;
The display control device according to claim 1, wherein the control unit displays a display object indicating a moving body that travels in a direction that matches the content of the guidance information from the guidance point as the guidance point display object. The control unit displays, as the guide point display object, a virtual image of a non-existent moving body that appears to exist in the vicinity of the guide point, and a virtual image of the mobile body that appears close to the guide point. The display control apparatus according to claim 1, wherein one display object and a second display object indicating a virtual image of the moving body that appears to be located farther from the guide point are displayed. The control unit displays, as the guide point display object, a virtual image of a non-existent moving body that appears to advance in a direction that matches the content of the guide information from the guide point, and a display object that indicates a virtual image of the mobile body. Item 4. The display control device according to Item 1. The display control device according to claim 1, wherein the control unit displays a virtual image of a nonexistent object that appears to be present at the guidance point when viewed from the driver of the vehicle as the guidance point display object. The display control apparatus according to claim 1, wherein the control unit displays a virtual image in which a road ahead of the guide point as viewed from the driver of the vehicle is colored as the guide point display object. A display control device according to claim 1;
A display device comprising the virtual image display unit. A display control device for controlling an image display unit,
An image acquisition unit that acquires a forward image that is an image of the front of the vehicle;
A guidance information acquisition unit that acquires guidance information that is route guidance information corresponding to a guidance point ahead of the vehicle from the vehicle navigation device;
A guide point position acquisition unit for acquiring the position of the guide point in the front image;
A control unit for controlling the display of the image display unit,
The control unit displays a guidance information display object, which is an image indicating the content of the guidance information, on the image display unit, and displays a guidance point display object, which is an image indicating the position of the guidance point, in the forward image. A display control apparatus, characterized by being superimposed on a shadow image and displayed on the image display unit. A moving body position acquisition unit that acquires a relative position of the moving body existing in front of the vehicle with respect to the guide point and a position of the moving body in the front image;
The control unit, as the guide point display object, a first display object indicating a moving body located closer to the guide point and a second display object indicating a mobile body located farther than the guide point. The display control apparatus according to claim 9. A moving body position acquisition unit that acquires a relative position of the moving body existing in front of the vehicle with respect to the guide point and a position of the moving body in the front image;
The display control apparatus according to claim 9, wherein the control unit displays a display object indicating a moving body that travels in a direction that matches the content of the guidance information from the guidance point as the guidance point display object. The control unit displays, as the guide point display object, an image of a non-existent moving body that appears to exist in the vicinity of the guide point, and an image of the mobile body that appears close to the guide point. The display control apparatus according to claim 9, wherein one display object and a second display object indicating an image of the moving body that appears to be located farther from the guide point are displayed. The control unit displays, as the guide point display object, an image of a non-existing moving body that appears to advance in a direction that matches the content of the guide information from the guide point, and a display object that indicates the image of the moving body. Item 10. The display control device according to Item 9. The display control device according to claim 9, wherein the control unit displays an image of a nonexistent object that appears to exist at the guidance point as the guidance point display object. The display control device according to claim 9, wherein the control unit displays an image coloring a road ahead of the guide point as the guide point display object. A display control device according to claim 9;
A display device comprising the image display unit. A route guidance method using a virtual image display unit,
The virtual image display unit
A virtual object that is a virtual image direction that is a direction of the virtual image with respect to a specific position of the vehicle, and a virtual image that is a distance to the virtual image, is a virtual object that is visible from the driver's seat of the vehicle through the windshield of the vehicle It can be displayed at the virtual image position defined by the distance,
The route guidance method is:
From the navigation device of the vehicle, obtaining guidance information that is information of route guidance corresponding to the guidance point ahead of the vehicle,
Obtaining a relative position of the guide point with respect to the vehicle;
A route guidance method characterized by displaying a guidance information display object which is a display object indicating the content of the guidance information and displaying a guidance point display object which is a display object indicating the position of the guidance point. A route guidance method using an image display unit,
Obtain a forward image, which is an image of the front of the vehicle,
From the navigation device of the vehicle, obtaining guidance information that is information of route guidance corresponding to the guidance point ahead of the vehicle,
Obtaining the position of the guide point in the forward image;
A guidance information display object that is an image showing the content of the guidance information is displayed on the image display unit, and a guidance point display object that is an image showing the position of the guidance point in the front image is superimposed on the front image. A route guidance method comprising displaying on the image display unit.

Images