JP2022176234A - Information display control device, information display control method, and information display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information display device capable of displaying a driving support image in which a correspondence relation with an actual road is easily understood and visibility is high.

SOLUTION: An information display control device includes: an image acquisition unit for acquiring a first image that is a scenery image around a mobile body photographed by a photographing unit mounted on the mobile body; a detection unit for detecting an obstacle existing in a traveling direction of the mobile body; and a display control unit that executes obstacle transmission processing for transmitting the obstacle detected by the detection unit in the first image and superimposes a driving support image for supporting drive of the mobile body on a second image that is a scenery image subjected to the obstacle transmission processing to cause a display unit mounted on the mobile body to display it.

SELECTED DRAWING: Figure 2

COPYRIGHT: (C)2023,JPO&INPIT

Description

TECHNICAL FIELD The present invention relates to an information display control device, and more particularly to an information display control device that displays information for a driver of a mobile object.

2. Description of the Related Art In an information display device such as a navigation device mounted on a mobile object such as a vehicle, a driving support image is displayed to support driving of the vehicle driver. For example, a belt-shaped route guidance image for guiding the route to be taken, and an image for indicating points where special attention should be paid to driving are displayed as the driving support image. At that time, the information display device displays the driving support image by a method of superimposing it on a photographed image of the actual landscape or a method of superimposing it as a virtual image on the actual landscape using a HUD (head-up display) or the like.

For example, when a driving support image is superimposed on a photographed image of an actual landscape, and an obstacle or the like exists in front of the vehicle, the driving support image and the obstacle are superimposed and displayed, indicating a driving caution point. Location and route guidance may become difficult to understand. Therefore, in order to avoid overlapping display of the route guidance image and the obstacles, an information display device has been proposed that displays the route guidance image at a position in the sky where there are no obstacles in the photographed image (for example, Patent Document 1).

JP 2012-233904 A

As described above, when a driving support image such as a route guidance image is displayed in the sky position in the captured image, one of the problems is that it is difficult to understand the correspondence between the driving support image and the actual road.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an information display device capable of displaying a highly visible driving support image in an easy-to-understand correspondence relationship with an actual road. is one of

The invention according to claim 1 is an information display control device, comprising: an image acquisition unit for acquiring a first image, which is a landscape image of the surroundings of the moving object, captured by an imaging unit mounted on the moving object; a detection unit that detects an obstacle present in a traveling direction of the moving object; and obstacle transparency processing that allows the obstacle detected by the detection unit to pass through the first image, and the obstacle transparency processing is completed. and a display control unit that superimposes a driving assistance image for assisting driving of the moving object on the second image, which is a landscape image, and displays the image on a display unit mounted on the moving object.

According to an eighth aspect of the invention, there is provided an information display control method executed by an information display control device for displaying an image on a display unit, wherein the surrounding scenery of the moving object photographed by the photographing unit mounted on the moving object. an image acquisition step of acquiring a first image that is an image; a detection step of detecting an obstacle present in a traveling direction of the moving object; and allowing the obstacle detected by the detection step to pass through the first image. Obstacle transparency processing is performed, and a driving assistance image for assisting driving of the moving object is superimposed on the second image, which is a landscape image after the obstacle transmission processing, and displayed on the display unit mounted on the moving object. and a display control step for displaying.

According to a ninth aspect of the invention, there is provided an information display control program, which is an image acquisition program for acquiring, in a computer, a first image, which is a landscape image of the surroundings of the moving object, photographed by a photographing unit mounted on the moving object. a detection step of detecting an obstacle present in the moving direction of the moving body; and an obstacle transmission process of transmitting the obstacle detected by the detection step in the first image, a display control step of superimposing a driving assistance image for assisting driving of the moving object on a second image, which is a landscape image that has undergone transparency processing, and displaying the image on the display unit mounted on the moving object. characterized by

1 is a block diagram showing an example of the configuration of an information display system according to Example 1 of the present invention; FIG. 1 is a block diagram showing an example of the configuration of an information display system of Example 1; FIG. 4 is a flow chart showing an example of an information display processing routine by the information display terminal of Example 1; 7 is a flow chart showing an example of an obstacle see-through processing routine by the information display terminal according to the first embodiment; It is a figure which shows an example of the screen displayed on a display part. It is a figure which shows an example of the screen displayed on a display part. It is a figure which shows an example of the screen displayed on a display part. It is a figure which shows an example of the screen displayed on a display part. It is a figure which shows an example of the screen displayed on a display part. FIG. 11 is a diagram schematically showing how information is displayed by the information display terminal of Example 2; 10 is a flow chart showing an example of an information display processing routine by the information display terminal of Example 2;

Preferred embodiments of the present invention are described in detail below. In the following description and accompanying drawings, substantially the same or equivalent parts are denoted by the same reference numerals.

FIG. 1 shows the configuration of an information display system 10 of Example 1. As shown in FIG. The information display system 10 includes an information display terminal 10A and a server device 10B as information display control devices. In this embodiment, an example in which the information display terminal 10A is mounted on a vehicle M as a moving object will be described.

The information display terminal 10A and the server device 10B can mutually transmit and receive data (communication connection) via a network (communication path). For example, a communication protocol such as TCP/IP is used for the transmission and reception. Also, the network can be constructed by Internet communication including wireless communication such as mobile communication network, Wi-Fi (registered trademark), and wired communication. The server device 10B can mutually transmit and receive data to and from each of the plurality of information display terminals 10A mounted on the plurality of vehicles M. FIG.

FIG. 2 shows the configuration of the information display terminal 10A and the server device 10B. The server device 10B exchanges data with a plurality of information display terminals (not shown) other than the information display terminal 10A. Therefore, a device ID for identifying the terminal is assigned in advance to the information display terminal 10A.

10 A of information display terminals have the camera 11 as an image acquisition part which acquires the scenery image around the vehicle M. FIG. The camera 11 is mounted, for example, on the front portion of the vehicle M, and captures the scenery in front including the road on which the vehicle M travels to obtain a scenery image.

The information display terminal 10A has a terminal storage unit 12 comprising a storage device such as a hard disk, flash memory, SSD (Solid State Drive), RAM (Random Access Memory). The terminal storage unit 12 appropriately stores programs executed in the information display terminal 10A, data required for the operation of the information display terminal 10A, data generated during the operation of the information display terminal 10A, and data taken in from the outside. For example, the terminal storage unit 12 stores map information including information on roads on which the vehicle M travels, and information such as driving caution points acquired from the server device 10B. In addition, the terminal storage unit 12 stores the image information of the landscape image captured by the camera 11 in association with information such as the date and time when the image was captured and the position and traveling direction of the vehicle M. The terminal storage unit 12 also stores the device ID of the information display terminal 10A.

The information display terminal 10A has a terminal control section 13 including a central processing unit (CPU). The terminal control unit 13 performs control necessary for the operation of the information display terminal 10A. For example, the terminal control unit 13 searches for a route to the destination of the vehicle M, requests information from the server device 10B, and controls the operation of each unit of the information display terminal 10A.

The image processing unit 14 performs image processing on the landscape image captured by the camera 11 . For example, the image processing unit 14 detects an obstacle located in front of the vehicle M from the scenery image (for example, an object existing on the road surface such as the vehicle in front), and makes the obstacle transparent in the scenery image. Execute obstacle transparency processing. The image processing unit 14 also generates a driving assistance image for assisting the driver's driving, and performs image processing such as superimposition of the driving assistance image on the landscape image and viewpoint conversion processing within the landscape image. The image processing unit 14 performs these image processes based on the information obtained from the server device 10B and the past landscape images stored in the terminal storage unit 12. FIG.

10 A of information display terminals have the display part 15 and the audio|voice output part 16 as a presentation part which presents information with respect to the driver|operator of the vehicle M. FIG.

The display unit 15 is a display device such as a liquid crystal display or an organic EL display, and is provided so as to be visually recognizable by the driver. The display unit 15 displays a landscape image around the vehicle M and a driving support image superimposed thereon under the control of the terminal control unit 13 .

The audio output unit 16 is an acoustic device that outputs navigation information to the destination of the vehicle M and other driving support information as audio. For example, the voice output unit 16 voice-outputs part of the route information and information on driving caution points.

The information display terminal 10A has an operation input section 17 comprising an input device such as a remote controller or touch panel. The operation input unit 17 receives an operation input from the passenger. For example, the operation input unit 17 receives operation inputs such as an input requesting display of route information and an input of a destination.

10 A of information display terminals have the position detection part 18 which is a device which detects the position of the vehicle M. FIG. The position detection unit 18 includes a position specifying device such as a GPS (Global Positioning System) receiver, detects the position of the vehicle M, and generates position information.

The information display terminal 10A has a terminal communication section 19 . The terminal communication unit 19 is a network adapter such as a NIC (Network Interface Card) for transmitting and receiving data according to instructions from the terminal control unit 13, for example. The terminal communication unit 19 as a transmission unit transmits, for example, the position information of the vehicle M, the device ID, the route information, the image information of the landscape image taken by the camera 11, and the like. The terminal communication unit 19 as a receiving unit receives, for example, driving support information including information on driving caution points such as accident-prone points.

Next, the server device 10B will be described. The server device 10B has a server communication section 21 . The server communication unit 21 is, for example, a network adapter such as a NIC, and transmits and receives data to and from one or more vehicles M. The server communication unit 21 as a transmission unit transmits distribution information including, for example, driving support information to the information display terminal 10A. Also, the server communication unit 21 as a receiving unit receives, for example, the position information of the vehicle M, the device ID, the route information, the image information of the landscape image, and the like from the information display terminal 10A.

The server device 10B has a server storage unit 22 comprising storage devices such as hard disks, flash memories, SSDs, and RAMs. The server storage unit 22 appropriately stores programs executed in the server device 10B, data necessary for the operation of the server device 10B, data generated during the operation of the server device 10B, and data taken in from the outside.

The server storage unit 22 has a map information DB 22A. The map information DB 22A stores map information including information on driving caution points such as accident-prone points.

The server storage unit 22 also stores a landscape image DB 22B. In the landscape image DB 22B, the image information of the landscape images received by the server communication unit 21 from a plurality of vehicles M is stored as the position information of the vehicles M, the traveling direction information, the lane in which the vehicle is traveling (for example, the right turn lane, the straight lane, etc.). and information on the date and time when the image was taken are stored in association with each other.

The server device 10B has a server control section 23 . The server control unit 23 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM, etc., and functions as a computer. The server control unit 23 implements various functions by reading and executing various programs stored in the server storage unit 22 . The server control section 23 includes a received image storage control section 24 .

The received image storage control unit 24 stores the image information of the landscape images received from the plurality of vehicles M by the server communication unit 21 as the position information of the vehicles M, the traveling direction information, the lane information on which the image is being taken, and the date and time when the image was taken. The landscape image DB 22B of the server storage unit 22 is stored in association with the information. At this time, the received image storage control unit 24 classifies the landscape images by, for example, the shooting position, time zone, season, lane, and traveling direction, and stores them in the landscape image DB 22B. Note that the received image storage control unit 24 may acquire weather information around the position based on the position information of the vehicle M, classify the scenery images according to weather conditions, and store them in the scenery image DB 22B. .

In addition, the received image storage control unit 24 performs image analysis before storing landscape images, and stores the landscape images in the landscape image DB 22B while excluding landscape images in which an obstacle such as a forward vehicle exists on the road surface. In addition, if there is already a landscape image with similar conditions such as photographed position, time, season, weather information, etc., the received image storage control unit 24 overwrites the newly acquired landscape image and stores it in the landscape image DB 22B. be memorized.

The server control section 23 also includes a transmission information generation section 25 . The transmission information generation unit 25 generates distribution information to be distributed (transmitted) to the information display terminal 10A. For example, based on the position information of the vehicle M, the transmission information generation unit 25 acquires position information of driving caution points such as accident-prone points around the position, and generates distribution information including the information of the driving caution points. In addition, the transmission information generation unit 25 receives the image request information including the position information of the vehicle M, the traveling direction information, and other environmental information (for example, the season, the time zone, the weather conditions, etc.), the server storage unit 22 scenery image stored in the scenery image DB of , and generates distribution information including the scenery image.

The information display processing routine RT1 executed by the information display terminal 10A will be described with reference to FIG.

The terminal control unit 13 of the information display terminal 10A starts an information display processing routine RT1, for example, when the accessory power supply (hereinafter referred to as ACC power supply) of the vehicle M is turned on. Note that the terminal control unit 13 may start the information display processing routine RT1 when the engine of the vehicle M is started.

The position detector 18 acquires current position information indicating the current position of the vehicle M (step S101).

The terminal control unit 13 controls the terminal communication unit 19 to transmit the movement information including the current position information of the vehicle M and the route information of the planned travel route set in the vehicle M to the server device 10B (step S102). . The terminal communication unit 19 may transmit the movement information to the server device 10B at predetermined time intervals.

The terminal communication unit 19 receives the driving support information including information on driving caution points around the vehicle M and information on route guidance, which is generated in the server device 10B based on the transmitted movement information (step S103).

Based on the received driving support information, the terminal control unit 13 identifies guidance points such as driving attention points and intersections located in the traveling direction of the vehicle M, and determines that the current position of the vehicle M is within a predetermined distance from the guidance points. It is determined whether or not it is within (step S104).

When it is determined that the current position of the vehicle M is not within the range of the predetermined distance from the guidance point (step S104: No), the terminal control unit 13 controls the image processing unit 14 to provide driving assistance for assisting the driving of the moving object. A sky support image is generated for displaying an image at a position in the sky above the landscape image. Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving caution point indication image indicating a driving caution point and a route guidance image as an aerial support image (step S105).

On the other hand, when it is determined that the current position of the vehicle M is within the range of the predetermined distance from the guidance point (step S104: Yes), the terminal control section 13 controls the image processing section 14 to display the landscape image captured by the camera 11. Then, it is determined whether or not there is an obstacle such as a forward vehicle on the road surface in front of the vehicle M (step S106).

When it is determined that there is no obstacle in front of the vehicle M (step S106: No), the terminal control section 13 stores the landscape image captured by the camera 11 in the terminal storage section 12 (step S107). At the same time, the image information of the landscape image captured by the camera 11 may be transmitted to the server device 10B together with the position information of the vehicle M at the time of capturing, the traveling direction information, and the information on the date and time of capturing.

When it is determined that there is an obstacle in front of the vehicle M (step S106: Yes), obstacle transparency processing for generating a transparent image showing the surrounding scenery of the vehicle M with part of the obstacle (for example, inside) transparent. is executed (step S108).

FIG. 4 is a flowchart showing an obstacle transparent processing routine RT2 executed by the information display terminal 10A.

The terminal control unit 13 captures an obstacle-free landscape image captured in the past in a shooting situation or shooting environment (for example, position, traveling direction, time zone, season, weather, etc.) corresponding to the scenery image shot by the camera 11. Alternatively, it is determined whether or not a landscape image (hereinafter referred to as an alternative image) that does not contain obstacles and has been received from the server device 10B in the past is stored in the terminal storage unit 12 (step S201).

When determining that the substitute image is stored in the terminal storage unit 12 (step S201: Yes), the terminal control unit 13 reads out and acquires the substitute image from the terminal storage unit 12 (step S202).

If it is determined that the substitute image is not stored in the terminal storage unit 12 (step S201: No), the terminal control unit 13 controls the terminal communication unit 19 to send an image request requesting transmission of the substitute image to the server device 10B. (step S203). The image request includes position information of the vehicle M, traveling direction information, and information designating the season, weather conditions, time zone, and the like.

As described above, the landscape image DB 22B of the server device 10B stores landscape images taken in a plurality of vehicles M. FIG. In response to the image request from the information display terminal 10A, the server device 10B extracts the corresponding scenery image from among the plurality of scenery images stored in the scenery image DV22B as a substitute image, and transmits it to the information display terminal 10A. The terminal storage unit 12 acquires the substitute image by receiving the image information of the substitute image from the server device 10B via the terminal communication unit 19 (step S204).

The image processing unit 14 aligns the landscape image captured by the camera 11 with the substitute image (step S205). For example, the image processing unit 14 detects a characteristic object (portion serving as a characteristic) that is commonly included in both images, and aligns the positions so that the degree of coincidence of the positions of the characteristic objects is high.

After completing the alignment, the image processing unit 14 detects edges of obstacles included in the landscape image (step S206).

Based on the detected edge of the obstacle, the image processing unit 14 selects an area of the alternative image to be superimposed on the obstacle in the landscape image captured by the camera 11 (that is, the position of the obstacle in the alternative image). area) is trimmed (step S207).

The image processing unit 14 superimposes the trimmed substitute image on the landscape image to generate a transparent image in which a part (for example, the inside) of the obstacle in the landscape image is pseudo-transparent (step S208). At that time, the image processing unit 14 generates a transmission image while changing the degree of transparency of the obstacle (for example, translucent, fully transparent, etc.) according to, for example, the distance from the vehicle M to the guidance point.

Referring to FIG. 3 again, the terminal control unit 13 controls the image processing unit 14 to generate a road surface support image for displaying a driving support image for supporting driving of the moving object on the road surface of the landscape image. Based on the driving assistance information received in step S103, the image processing unit 14 generates a driving assistance image including a driving caution point indication image indicating a driving caution point and a route guidance image as a road surface assistance image (step S109).

The terminal control unit 13 controls the display unit 15 to display the air support image generated by the image processing unit 14 in step S105 or the road surface support image generated in step S109 as the landscape image captured by the camera 11 or the obstacle in step S108. It is superimposed and displayed on the transmission image generated by the object transmission processing (step S110).

FIG. 5A shows an example of an image displayed on the display unit 15 when the vehicle M is not approaching the guidance point (that is, when the current position of the vehicle M is not within a predetermined distance from the guidance point). It is a diagram. A driving caution point instruction image DC indicating driving caution points such as accident-prone points and a route guidance image RG are displayed as driving support images at positions above the scenery image. Also, the forward vehicle FV of the vehicle M is displayed as it is.

FIG. 5B is a diagram showing an example of an image displayed on the display unit 15 when the vehicle M approaches the guidance point. When the vehicle M approaches the guidance point, the driving support image (sky support image) displayed in the sky position in the scenery image fades out, and the driving support image (road surface support image) fades in to the position on the road surface. displayed.

FIG. 5C is a diagram showing an example of an image displayed on the display unit 15 when the vehicle M approaches the guidance point. When the vehicle M approaches the guide point, the forward vehicle FV is detected as an obstacle, and a transparent image showing the interior of the forward vehicle FV is displayed. At that time, the degree of transparency of the forward vehicle FV changes according to the distance between the vehicle M and the guidance point, and as the vehicle M approaches the guidance point, the forward vehicle FV gradually becomes transparent (for example, in a translucent state). ) is displayed so that it becomes fully transparent.

FIG. 5D is a diagram showing an example of an image displayed on the display unit 15 when the vehicle M further approaches the guidance point. When the vehicle M approaches the guidance point even further than the state shown in FIG. 5C, the interior of the forward vehicle FV, which is an obstacle, is displayed in a completely transparent state. At that time, in order to indicate the position of the forward vehicle FV, for example, an outline image FVC showing the outline of the forward vehicle FV is displayed.

FIG. 5E is a diagram showing another example of the image displayed on the display unit 15 when the vehicle M approaches the guidance point. Here, instead of displaying the outline of the front vehicle FV, which is an obstacle, through the inside, the upper part of the front vehicle FV is displayed while the lower part (the part overlapping the road surface) is shown as an example. ing. In this way, the transmission image may be an image that transmits through the portion of the obstacle on which the driving support image overlaps.

Although the information display terminal 10A generates the driving support image based on the driving support information received from the server device 10B, the information display terminal 10A is not limited to this. The unit 12 may store map information including position information of the driving caution points, and generate a driving support image including the driving caution point indication image and the route guidance image based on the map information.

As described above, the information display terminal 10A of this embodiment superimposes the driving support image on the landscape image and displays it when the vehicle M is away from the driving attention point or the guidance point such as the intersection. Let As a result, the driver driving the vehicle M can visually recognize the driving support image regardless of the road surface conditions such as the presence or absence of obstacles, and can roughly grasp the position of the driving attention point and the route guidance information. It becomes possible.

Further, when the vehicle M approaches the guidance point, the information display terminal 10A of the present embodiment superimposes and displays the driving support image on a position near the ground (for example, on the road surface) of the scenery image. As a result, the driver who drives the vehicle M can specifically recognize the position of the caution point and the route guidance in association with the road surface.

Further, when an obstacle such as a forward vehicle exists in the traveling direction of the vehicle M, the information display terminal 10A of the present embodiment displays a portion of the obstacle (for example, , inside) is displayed. As a result, the driver driving the vehicle M can recognize the position of the driving attention point and the route guidance without being hindered by the obstacles.

An information display system according to a second embodiment will be described with reference to FIGS. 6 and 7. FIG. The information display system of this embodiment differs from the information display system of Embodiment 1 shown in FIG. 2 in the configuration and operation of the display unit 15 of the information display terminal 10A.

The display unit 15 of this embodiment is a head-up display (HUD) that displays a virtual image superimposed on the actual scenery in front of the vehicle M. FIG. The display unit 15 displays driving support images including the driving attention point instruction image and the route guidance image as virtual images.

As shown in FIG. 6, the display unit 15 has a projection device 31 and a reflector 32 . The projection device 31 projects image light representing the driving support image generated by the image processing unit 14 toward the reflecting mirror 32 . The image light reflected by the reflecting mirror 32 is reflected by the windshield FG of the vehicle M and enters the pupil of the driver.

The information display processing routine RT3 executed by the information display terminal 10A of this embodiment will be described with reference to FIG. The terminal control unit 13 of the information display terminal 10A starts the information display processing routine RT3 when the ACC power of the vehicle M is turned on.

The position detector 18 acquires current position information indicating the current position of the vehicle M (step S301).

The terminal control unit 13 controls the terminal communication unit 19 to transmit the movement information including the current position information of the vehicle M and the route information of the planned travel route set in the vehicle M to the server device 10B (step S302). . The terminal communication unit 19 may transmit the movement information to the server device 10B at predetermined time intervals.

The terminal communication unit 19 receives the driving support information including information on driving caution points around the vehicle M and information on route guidance, which is generated in the server device 10B based on the transmitted movement information (step S303).

Based on the received driving support information, the terminal control unit 13 identifies guidance points such as driving attention points and intersections located in the traveling direction of the vehicle M, and determines that the current position of the vehicle M is within a predetermined distance from the guidance points. It is determined whether or not it is within (step S304).

When it is determined that the current position of the vehicle M is not within the range of the predetermined distance from the guidance point (step S304: No), the terminal control unit 13 controls the image processing unit 14 to provide driving assistance for assisting the driving of the moving object. A sky support image is generated for displaying an image at a position in the sky above the landscape image. Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving caution point indication image indicating a driving caution point and a route guidance image as an aerial support image (step S305).

The projection device 31 of the display unit 15 projects image light corresponding to the sky support image onto the upper end side of the reflecting mirror 32 (step S306). The image light reflected by the upper end side of the reflecting mirror 32 is reflected by the upper end side of the windshield FG and enters the pupil of the driver. As shown in FIG. 6, the driver visually recognizes the sky support image UG superimposed near the sky above the scenery in front of the vehicle M through the windshield FG.

When it is determined in step S304 that the current position of the vehicle M is within the range of the predetermined distance from the guidance point (step S304: Yes), the terminal control unit 13 controls the image processing unit 14 to assist the driving of the mobile object. A road surface support image for displaying the driving support image on the road surface of the scenery image is generated. Based on the driving assistance information received in step S103, the image processing unit 14 generates a driving assistance image including a driving caution point indication image indicating a driving caution point and a route guidance image as a road surface assistance image (step S307).

The projection device 31 of the display unit 15 projects image light corresponding to the road surface support image onto the lower end side of the reflecting mirror 32 (step S308). The image light reflected by the lower end side of the reflecting mirror 32 is reflected by the lower end side of the windshield FG and enters the pupil of the driver. As shown in FIG. 6, the driver visually recognizes the road support image DG superimposed near the ground in the landscape in front of the vehicle M through the windshield FG.

As described above, the information display terminal 10A of the present embodiment displays the driving support image at a position above the scenery in front of the vehicle M when the vehicle M is away from the driving attention point or the guidance point such as the intersection. A virtual image is superimposed and displayed. As a result, the driver driving the vehicle M can visually recognize the driving support image regardless of the road surface conditions such as the presence or absence of obstacles, and can roughly grasp the position of the driving attention point and the route guidance information. It becomes possible.

Further, when the vehicle M approaches the guidance point, the information display terminal 10A of the present embodiment superimposes a virtual image of the driving assistance image on a position near the ground (for example, on the road surface) of the scenery in front of the vehicle M. to display. As a result, the driver who drives the vehicle M can specifically recognize the position of the caution point and the route guidance in association with the road surface.

In addition, this invention is not limited to the said embodiment. For example, in the above embodiment, an example in which the information display terminal 10A is mounted on the vehicle M as a moving object has been described. However, the information display terminal 10A is not limited to an in-vehicle device such as an in-vehicle navigation device, and may be a mobile terminal, smart phone, or the like capable of executing a navigation function.

Further, in the first embodiment, an example has been described in which the display unit 15 displays a transparent image showing the inside and the lower part of the obstacle through the obstacle. However, the target to be transmitted in the transmission image is not limited to the inside or the lower portion of the obstacle, and any object that allows at least part of the obstacle to be transmitted through may be used.

Further, in the first embodiment, an example of displaying an image showing the outline of an obstacle together with a transparent image, and an example of allowing the lower part of the obstacle to be transparent while leaving the upper part of the obstacle are explained. However, unlike these, an image in which the entire obstacle is transparent (that is, an image in which the obstacle is completely invisible) may be displayed as a transparent image. In this case, it is possible to display the substitute image as it is as a transparent image without trimming the substitute image by the image processing unit 14 .

Further, in the above embodiment, when the distance from the vehicle M to the guidance point is greater than or equal to a predetermined distance, the driving support image is displayed at a position in the sky. ) has been described as an example in which the driving support image is displayed. However, the position where the driving support image is displayed is not limited to these. When the distance from the vehicle M to the guidance point is equal to or greater than a predetermined distance, the display unit 15 displays the image at the first height position in the scenery image. A driving support image is displayed, and if the distance is less than a predetermined distance, the driving support image is displayed at a second height position lower than the first height. That is, the display unit 15 may change the height of the display position of the driving support image according to the distance from the vehicle M to the guidance point.

In addition to changing the height of the display position of the driving support image according to the distance from the vehicle M to the guidance point, the display unit 15 changes the height of the display position of the driving support image according to the presence or absence of obstacles. can be changed. For example, when there is an obstacle such as a forward vehicle in the traveling direction of the vehicle M and the distance to the guidance point is greater than or equal to a predetermined distance, the display unit 15 is displayed at a first height (for example, in the sky). A driving support image is displayed, and if there are no obstacles and the distance to the guidance point is equal to or greater than a predetermined distance, a position at a second height lower than the first height (for example, several meters from the road surface) is displayed. When the distance to the guidance point is less than a predetermined distance, a third height lower than the second height is displayed regardless of the presence or absence of obstacles. For example, the configuration may be such that the driving support image is displayed at a position (on the road surface).

10 Information display system 10A Information display terminal 10B Server device 11 Camera 12 Terminal storage unit 13 Terminal control unit 14 Image processing unit 15 Display unit 16 Audio output unit 17 Operation input unit 18 Position detection unit 19 Terminal communication unit 21 Server communication unit 22 Server Storage unit 22A Map information DB
22B Scenery image DB
23 Server control unit 24 Received image storage control unit 25 Transmission information generation unit 31 Projector 32 Reflector

Claims (9)

an image acquisition unit that acquires a first image, which is a landscape image of the surroundings of the mobile object, captured by an imaging unit mounted on the mobile object;
a detection unit that detects an obstacle present in the moving direction of the moving object;
Driving that assists the driving of the moving body by performing obstacle transparency processing for allowing the obstacles detected by the detection unit to pass through the first image, and displaying a second image that is a landscape image after the obstacle transparency processing. a display control unit that superimposes a support image and displays it on a display unit mounted on the moving object;
An information display control device comprising: 2. The display control unit according to claim 1, wherein, when the obstacle is not detected by the detection unit, the driving support image is superimposed on the first image and displayed on the display unit. Information display controller. When superimposing an aerial driving assistance image for displaying the driving assistance image at a location in the sky in the landscape image, the display control unit superimposes the aerial driving assistance image on the first image to display the driving assistance image. 2. The information display control device according to claim 1, wherein the information display is displayed on the unit. When superimposing the ground driving support image for displaying the driving support image at a position in the vicinity of the ground in the scenery image, the display control unit controls the display control unit to display the driving support image at a position near the ground in the landscape image, if the obstacle is not detected by the detection unit, the first The ground driving support image is superimposed on the image, and when the obstacle is detected by the detection unit, the ground driving support image is superimposed on the second image and displayed on the display unit. The information display control device according to claim 3. 5. The information display control device according to any one of claims 1 to 4, wherein the display control unit displays a transparent outline of the obstacle in the second image. 6. The display control unit changes the degree of transparency of the obstacle in the second image according to the distance from the moving body to a predetermined guide point. The information display control device according to 1. The display control unit corresponds to the area in the first image in which the obstacle exists, in a past landscape image that does not include the obstacle and is photographed at a point corresponding to the first image. 7. The information display control device according to any one of claims 1 to 6, wherein the obstacle transparent processing is performed by superimposing a portion where the obstacle is transparent. An information display control method executed by an information display control device for displaying an image on a display unit,
an image acquisition step of acquiring a first image, which is a landscape image of the surroundings of the mobile object, captured by an imaging unit mounted on the mobile object;
a detection step of detecting an obstacle present in the moving direction of the moving object;
Execution of obstacle transparency processing for allowing the obstacles detected by the detection step to pass through the first image, and assisting the driving of the moving body in a second image that is a landscape image after the obstacle transparency processing. a display control step of superimposing a support image and displaying it on a display unit mounted on the moving object;
An information display control method, comprising: to the computer,
an image acquisition step of acquiring a first image, which is a landscape image of the surroundings of the mobile object, captured by an imaging unit mounted on the mobile object;
a detection step of detecting an obstacle present in the moving direction of the moving object;
Execution of obstacle transparency processing for allowing the obstacles detected by the detection step to pass through the first image, and assisting the driving of the moving body in a second image that is a landscape image after the obstacle transparency processing. a display control step of superimposing a support image and displaying it on a display unit mounted on the moving object;
An information display control program characterized by executing

Images