JP2012091531A - Display control device and on-board display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display control device and an on-board display system that display both an improved field-of-front-vision image and an information provision image on one display while preventing the visibility of the improved field-of-front-vision image from decreasing.SOLUTION: In the on-board display system 1, the display control device 40 superposes and displays a transparent image of the information provision image on the improved field-of-front-vision image within a display area A of a display 30 capable of displaying the improved field-of-front-vision image and a map image, on the basis of the acquisition of the information provision image while at least the improved field-of-front-vision image between the improved field-of-front-vision image and the map image is displayed.

Description

  The present invention relates to a display control device that superimposes and displays an information providing image for providing information on a front view improvement image in which a view in front of a vehicle is improved, and an in-vehicle display system including the display control device.

  Conventionally, for example, a technique described in Patent Document 1 is known. This Patent Document 1 discloses a night view camera that acquires a night vision image that is an image of a night environment, a center display that can display a night vision image together with a map image, and a map image and night vision on the center display. When the image is displayed, if it is necessary to display another information providing image (for example, a branching point enlarged image) different from the map image and the night vision image, the information providing image is displayed on the center display. Is displayed (hereinafter referred to as a first display device). In other words, the first display device is a display device that simultaneously displays a night vision image and an information providing image on the same display. FIG. 14A shows a display example in which only a night vision image is displayed on this display, and FIG. 14B shows a display example in which both the night vision image and the information providing image are simultaneously displayed on this display. Shown in

  Patent Document 1 discloses a night view camera that captures a night-time image by capturing a night environment, a center display that can display a night-vision image together with a map image, and a map image and night-vision on the center display. A device that displays an information providing image on a head-up display different from the center display when the information providing image needs to be displayed in a situation where the image is displayed (hereinafter referred to as a second display device). Description) is described. In other words, the second display device is a display device that uses two displays, displays a night vision image on one display, and displays an information providing image on the other display. FIG. 15A shows a display example in which only a night vision image is displayed on one display (center display), and a display example in which only an information providing image is displayed on the other display (head-up display). As shown in FIG.

JP 2009-57010 A

  By the way, in the display by the first display device, as shown in the comparison between the size of the night vision image shown in FIG. 14A and the size of the night vision image shown in FIG. In order to secure the display area of the image for use, the display area of the night vision image is reduced before and after the display of the information providing image. Accordingly, the visibility of the night vision image is reduced.

  In addition, the second display device uses two displays, which is disadvantageous in terms of cost. Furthermore, in the display by the second display device, it is necessary for the user to view two displays in order to obtain information from both the night vision image and the information providing image. As a result, the user needs to move the line of sight, or the user needs extra time for focusing.

  In the first display device and the second display device, a night vision image obtained by imaging a night environment is displayed. In addition to the night vision image, an image taken by a visible light camera in a situation where fog occurs. The above-mentioned problem similarly occurs even in a forward view improved image that is an image in which the forward view is improved, such as a restored image in which the influence of fog is reduced.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to prevent both the forward visibility improved image and the information providing image from being displayed on one display while preventing the visibility of the forward visibility improved image from being lowered. An object is to provide a display device and an in-vehicle display system capable of displaying.

  In order to achieve such an object, according to the first aspect of the present invention, the front view improvement image acquisition that acquires the front view improvement image from the front view improvement image generation device that generates the front view improvement image that improves the view ahead of the vehicle is obtained. Means for obtaining information providing image from an information providing device for generating an information providing image, which is an image for providing information, and while the forward view improvement image is displayed on the display And a display control unit that superimposes and displays a transparent image of the information providing image on the forward view improvement image based on the acquisition of the information providing image.

  In the above configuration as the display control device, since the transmission image of the information providing image is superimposed and displayed on the front view improving image by the display control means, the front view improving image is secured in order to secure the display area of the information providing image. Unlike the first display device in which the display area is reduced, it is not necessary to reduce the display area of the forward view improvement image. Therefore, the visibility of the information providing image does not deteriorate.

  Further, in the above configuration as the display control device, since the transmission image of the information providing image is superimposed and displayed on the front view improving image by the display control means, the display for displaying the front view improving image and the information providing image are displayed. Unlike the second display device, which needs to prepare each display for display, only one display is required. Therefore, the user can acquire information from both the forward view improvement image and the information providing image by looking at one display, and the user needs extra time for focusing. Will disappear.

  Therefore, according to the said structure as a display control apparatus, it can display both a front view improvement image and the image for information provision on one display, preventing the fall of the visibility of a front view improvement image. Become.

  In the configuration according to claim 1, in the invention according to claim 2, a map image and an image different from the map image and the forward view improvement image are generated as information providing images, and the generated map image And a map image acquisition means for acquiring a map image from a route guidance device as an information provision device that guides a route using an information providing image, and the display control means can display a forward view improvement image and a map image The information providing image is displayed on the front view improving image on the basis of the fact that the information providing image is acquired while at least the front view improving image among the front view improving image and the map image is displayed on the display. The transparent image is superimposed and displayed. According to the configuration described in claim 2, it is possible to display a map image on one display in addition to the front view improvement image and the information providing image while preventing the visibility of the front view improvement image from being deteriorated. become.

  The location where the information providing image is superimposed and displayed on the forward visibility improving image is arbitrary. However, since the obstacle is often positioned below the vanishing point of the front vision improvement image, when the information providing image is displayed below the vanishing point of the front vision improvement image, the obstacle provides information. It may be difficult to see due to the image for use, and the user may be prevented from recognizing the obstacle.

  Therefore, in the configuration according to claim 2, as in the invention according to claim 3, when the display control means superimposes and displays the transmission image of the information providing image above the vanishing point of the forward visibility improved image. Good. Thereby, it can reduce that an obstruction becomes difficult to see with the image for information provision, and it does not prevent a user recognizing an obstruction.

  However, in the configuration according to claim 3, as in the invention according to claim 4, the information providing image includes an arrow image that is an image of an arrow indicating a course direction, and the display control means Displays the transparent image of the information providing image above the vanishing point of the front vision improved image, and the transparent image of the arrow image in the information providing image is below the vanishing point of the front visual improved image. It is good to superimpose. Since the road is often located below the vanishing point of the forward visibility improvement image, by displaying the arrow image below the vanishing point in a superimposed manner, the user of the device can obtain information on the road shape and the course. Such information can be viewed at a time.

  In the configuration described in claim 4, as in the invention described in claim 5, the display control means is configured such that the current location of the vehicle on which the display control device is mounted is within a predetermined region with respect to the branch point of the road. When it reaches, based on the fact that the arrow image output from the route guidance device that outputs the arrow image to the display control device is acquired, the transmission image of the arrow image may be superimposed and displayed on the front view improvement image. As a result, when the current location of the vehicle on which the display control device is mounted reaches a predetermined area from the branch point, the transmitted image of the arrow image is superimposed on the forward visibility improving image, so that the user of the device can The direction can be suitably recognized.

  Similarly, in the configuration according to any one of claims 3 to 5, as in the invention according to claim 6, a path character that is an image of a character string that refers to a direction to travel is included in the information providing image. The display control means displays a route character string image on the display control device when the current location of the vehicle on which the display control device is mounted reaches a predetermined area with reference to a branch point of the road. Based on the acquisition of the route character string image output from the output route guidance device, a transparent image of the route character string image may be superimposed and displayed on the forward visibility improving image. This also causes the transmission image of the course character string image to be superimposed and displayed on the front view improvement image when the current location of the vehicle equipped with the display control device reaches the predetermined region from the branch point. The user can preferably recognize the course direction.

  Further, in the configuration according to any one of claims 2 to 6, in the invention according to claim 7, in the front image, based on the front image that is an image captured by the imaging device that captures the front image. From the obstacle detection device that outputs obstacle detection information, which is a signal indicating that, to the display control device. When the obstacle detection information acquisition unit further acquires the obstacle detection information, and the display control unit does not acquire the obstacle detection information by the obstacle detection information acquisition unit, the obstacle detection information acquisition unit acquires the obstacle. Compared to the case where the object detection information is acquired, the transparent image of the information providing image is superimposed and displayed on the front view improvement image so that the transparent image of the information providing image is emphasized.

  In the above configuration as the display control device, when there is an obstacle located in the front image, the forward visibility is improved so that the transmitted image of the information providing image is not emphasized as there is no obstacle located in the front image. Since the transparent image of the information providing image is superimposed and displayed on the image, it is possible to reduce the attention of the user of the apparatus toward the transparent image of the information providing image, and consequently, an obstacle located in the front image. Collisions with objects can be avoided. Further, in the above configuration as the display control device, when there is no obstacle located in the front image, the transmission image of the information providing image is emphasized compared to the case where there is an obstacle located in the front image. Since the transparent image of the information providing image is superimposed and displayed on the forward view improvement image as described above, it is possible to promote the attention of the user of the device toward the transparent image of the information providing image. The information can be suitably transmitted to the mobile phone.

  Further, in the configuration according to any one of claims 2 to 6, the invention according to claim 8 is an image captured by an imaging device that captures a route guided by the route guidance device and a forward image. When it is determined that there is an obstacle located on the route in the front image based on the front image, the obstacle detection device that outputs the obstacle detection information indicating that fact to the display control device from the obstacle detection device An obstacle detection information acquisition means for acquiring detection information is further provided. When the obstacle detection information acquisition means does not acquire the obstacle detection information, the display control means detects the obstacle by the obstacle detection information acquisition means. The transparent image of the information providing image is superimposed and displayed on the front view improvement image so that the transparent image of the information providing image is emphasized as compared with the case where the information is acquired.

  In the above configuration as the display control device, when it is determined that there is an obstacle in the front image, the obstacle detection information acquisition unit does not acquire the obstacle detection information, but the obstacle is on the path in the front image. When it is determined that there is an obstacle, the obstacle detection information acquisition unit acquires the obstacle detection information. Therefore, compared with the structure of the said Claim 6, while being able to avoid the collision with the obstacle located in a front image more accurately, it can transmit information to a user more suitably. Will be able to.

  Specifically, in the configuration according to claim 7 or 8, when the display control means does not acquire obstacle detection information by the obstacle detection information acquisition means, as in the invention according to claim 9. In other words, the transparency of the information providing image is emphasized by reducing the transparency of the transparent image of the information providing image as compared with the case where the obstacle detection information is acquired by the obstacle detection information acquiring means. In addition, a transparent image of the information providing image may be superimposed and displayed on the forward visibility improving image.

  In addition, in the configuration according to any one of claims 7 to 9, as in the invention according to claim 10, the information providing image includes a simplified map image obtained by simplifying a map image, and proceeds. When the path character string image which is an image of the character string referring to the power direction is included and the display control means does not acquire the obstacle detection information by the obstacle detection information acquisition means, the obstacle detection information Compared to the case where the obstacle detection information is acquired by the acquisition means, by reducing the transparency of the transparent image of the information providing image other than the simplified map image and the course character string image among the information providing images, When the transparent image of the information providing image is superimposed and displayed on the front view improvement image so that the transparent image of the information providing image other than the simplified map image and the course character string image is emphasized among the information providing images. Good.

  According to the configuration described in claim 9 as the display control device, as compared with the configuration according to claim 8, the route guidance function is left as much as possible without obstructing the field of view of the obstacle. Will be able to.

  In addition, in the forward visibility improvement image, a night vision image that is a grayscale image with an improved forward visibility at night taken by a night view camera as an imaging device, or a situation where fog is generated by a visible light camera as an imaging device There is a restored image that is an image in which the influence of fog is reduced from the image captured in (1). Therefore, as in the invention described in claim 11, the forward visual field improvement image acquisition unit may acquire a night vision image as the forward visual field improvement image from the forward visual field improvement image generation device that generates the night vision image. . Alternatively, the visual field improvement image acquisition unit may acquire the restored image as the forward visual field improvement image from the forward visual field improvement image generation device that generates the restored image. Alternatively, the visual field improvement image acquisition means acquires at least one of the night vision image and the restored image as the forward visual field improvement image from the forward visual field improvement image generation device that generates the night vision image and the restored image. May be.

  In the configuration described in claim 11, as in the invention described in claim 12, when the obstacle detection information acquisition means does not acquire the obstacle detection information, the display control means improves the forward visibility. A transparent image of the information providing image may be displayed as a color image on the night vision image acquired by the image acquisition means. Thereby, it is possible to favorably enhance the transmission image of the information providing image on the night vision image.

  In the configuration described in claim 11 or 12, as in the invention described in claim 13, the display control means moves forward when the obstacle detection information is acquired by the obstacle detection information acquisition means. The transmission image of the information providing image may be displayed as a gray scale image on the night vision image acquired by the visibility improving image acquisition means. Thereby, the transparent image of the information providing image can be suitably prevented from being emphasized on the night vision image.

  In the configuration according to any one of claims 2 to 13, in the invention according to claim 14, the display control means provides the front view improving image and the map image in a plurality of display areas obtained by dividing the entire display area. A transparent image of the information providing image may be superimposed and displayed on the forward visibility improving image displayed on the display capable of display. Alternatively, in the configuration according to any one of claims 2 to 14, in the invention according to claim 15, the display control means switches the front view improvement image and the map image to the entire display area and switches either one of them. A transparent image of the information providing image may be superimposed and displayed on the forward visibility improving image displayed on the display capable of display.

  The invention described in claim 16 includes the display control device according to any one of claims 1 to 15, and a front view improvement image generation device that generates a front view improvement image in which the front view is improved. And an information providing apparatus that generates an information providing image that is an image for providing information.

1 is a block diagram showing an overall configuration of an in-vehicle display system according to an embodiment of the present invention. It is a block diagram which shows the detailed structure about the route guidance apparatus which comprises the vehicle-mounted display system of this Embodiment. It is a block diagram which shows the detailed structure about the front view improvement image generation apparatus which comprises the vehicle-mounted display system of this Embodiment. It is a block diagram which shows the detailed structure about one Embodiment of the display control apparatus which concerns on this invention. (A) is a figure which shows the example of a display when route guidance is not performed about the case where display mode is set to the forward visibility improvement image display mode, (b) is the figure where route guidance is performed. It is a figure which shows the example of a display when there is. It is a figure which shows the example of a display in case the display mode is set to the combination mode. When the display mode is set to the map image display mode, (a) is a diagram showing a display example when the branching point enlarged image is not displayed as the information providing image, and (b) is the information It is a figure which shows the example of a display when the branching point enlarged image is displayed as a provision image. It is a figure which shows the example of a display of the night vision image and the image for information provision by the display control apparatus of this Embodiment. It is a flowchart which shows an example of the process sequence in case the image output mode of the front vision improvement image generation apparatus 20 is a night vision image output mode about the display process performed by the display control apparatus of this Embodiment. It is a flowchart which shows an example of the process sequence in case the image output mode of the front vision improvement image generation apparatus 20 is a restoration image output mode about the display process performed by the display control apparatus of this Embodiment. It is a flowchart which shows an example of the process sequence in case it is the image output stop mode of the front view improvement image generation apparatus 20 about the display process performed by the display control apparatus of this Embodiment. It is a figure which shows the example of a display of the night vision image and the image for information provision by the display control apparatus of the modification of this Embodiment. It is a figure which shows the example of a display of the night vision image and the image for information provision by the display control apparatus of the other modification of this Embodiment. (A) is a figure which shows the example of a display when only a night vision image is displayed about the 1st display apparatus which is a conventional display apparatus, (b) displayed the night vision image and the image for information provision It is a figure which shows the example of a display in a case. (A) is a figure which shows the example of a display of the night vision image displayed on one display about the 2nd display apparatus which is a conventional display apparatus, (b) is the information provision displayed on the other display It is a figure which shows the example of a display of the image for business.

  An embodiment of a display control device and an in-vehicle display system according to the present invention will be described with reference to FIGS.

  The in-vehicle display system 1 is mounted on a vehicle (not shown), and includes a route guidance device 10, a front view improvement image generation device 20, a display 30, and a display control device 40, as shown in FIG. Yes.

  First, the configuration and functions of the route guidance device 10 will be described with reference to FIG. The route guidance device 10 includes a control unit 11, a storage unit 12, a GPS reception unit 13, and a voice output unit 14, and is connected to a display control device 40.

  The control unit 11 is a computer having a known CPU and a built-in memory (both not shown), and the CPU executes various programs by executing programs stored in the built-in memory. Yes.

  The storage unit 12 includes, for example, a hard disk drive device, a DVD (digital versatile disc) device, a CD (compact disc) device, a flash memory, and the like, and includes map information including road data, a map image, this map image, and a forward view. An image different from the improved image, an information providing image for providing information to the user of the in-vehicle display system 1, and a route for inputting start point information, destination information, a route guidance start instruction, and the like Guidance operation images are stored. The storage unit 12 is connected to the control unit 11, and data stored in the storage unit 12 is appropriately read out by the control unit 11. The forward view improvement image, the information providing image, the route guidance operation image, and the like will be described later.

  The GPS receiving unit 13 includes a GPS antenna and is connected to the control unit 11. The GPS receiver 13 receives GPS signals emitted from a plurality of GPS satellites (not shown) at predetermined intervals, and outputs the received GPS signals to the controller 11.

  The control unit 11 reads out the route guidance operation image stored in the storage unit 12, outputs the read route guidance operation image to the display control device 40, and displays the route guidance operation image in the display area of the display 30. Display. Then, when the route guidance operation image is touched by the user of the in-vehicle display system 1, the departure point information that is the departure point information, the destination information that is the destination information, and the departure point to the destination point. A route guidance start instruction or the like for guiding a route is input to the control unit 11 via the display control device 40.

  The control unit 11 acquires a GPS signal from the GPS receiving unit 13 and detects the current location of the vehicle using the GPS signal. In addition, the control part 11 reads the map information memorize | stored in the memory | storage part 12 in the detection of the present location of a vehicle, and well-known map matching is performed based on the driving | running locus and road data of the vehicle carrying the said vehicle-mounted display system 1. FIG. By executing, the error of the current location determined based on the GPS signal is corrected. In addition, the control unit 11 searches for a route from the departure point to the destination by using the input departure point information and destination information and the map information acquired from the storage unit 12.

  When the route guidance start instruction is input and the route to the destination is guided, the control unit 11 sequentially calculates the remaining distance on the route from the current location to the destination, and the in-vehicle display system 1 Is calculated, and the estimated arrival time is sequentially calculated using the calculated average hourly speed and the calculated distance.

  When the route guidance start instruction is input to guide the route to the destination, the control unit 11 outputs the “map image including the route” and the information providing image to the display control device 40. At the same time, a voice guidance is output from the voice output unit 14 composed of, for example, a speaker and the route is guided to the user. On the other hand, the control unit 11 outputs “a map image including the current location” to the display control device 40 when the route guidance start instruction is not input and the route to the destination is not guided.

  Next, the configuration and function of the front view improvement image generation apparatus 20 will be described with reference to FIG. The forward vision improvement image generation device 20 includes a control unit 21, an operation unit 22, a night view camera 23, a projector 24, a visible light camera 25, an image processing unit 26, and the like, and is connected to the display control device 40. Has been.

  The control unit 21 is a computer having a known CPU and a built-in memory (both not shown), and the CPU executes various programs by executing programs stored in the built-in memory. Yes. The built-in memory stores an output image selection operation image for selecting an image output mode to be described later.

  In this embodiment, the operation unit 22 includes a plurality of push switches respectively associated with a plurality of image output modes, and the plurality of push switches are arranged, for example, in the vicinity of a steering wheel (not shown). , Connected to the control unit 21.

  It should be noted that, in a plurality of image output modes, a “night vision image output mode” in which a night vision image captured by the night view camera 23 is output to the display control device 40, and imaging by the visible light camera 25 in a situation where fog occurs. “Restored image output mode” for outputting a restored image in which the influence of fog is reduced by the image processing unit 26 to the display control device 40 from the generated image, and stopping the output of the night vision image or the restored image to the display control device 40 There is an “image output stop mode”.

  When the push switch is pushed, image output mode information that is image output mode information associated with the operated push switch is input to the control unit 21, and the control unit 21 receives the input. Based on the image output mode information, the night view camera 23, the projector 24, the visible light camera 25, the image processing unit 26, and the like are controlled. The control unit 21 outputs the input image output mode information to the display control device 40. The display control device 40 sets the input image output mode in order to set a display mode of the display 30, which will be described later. Use information.

  The control unit 21 reads a plurality of output image selection operation images stored in the built-in memory or the like, and outputs the read output image selection operation images to the display control device 40 to display on the display 30. The plurality of output image selection operation images are displayed in the area. The plurality of output image selection operation images are also associated with the plurality of image output modes of the front view improvement image generation device 20, respectively. Then, when one of the plurality of output image selection operation images is touched by the user of the in-vehicle display system 1, the image output is information on the image output mode associated with the touched output image selection operation image. The mode information is input to the control unit 21 via the display control device 40 (specifically, the display control unit 45), and the control unit 21 selects the night view camera 23, the projector 24, the projector 24 based on the input image output mode information. The visible light camera 25 and the image processing unit 26 are controlled. The display control device 40 uses the input image output mode information in order to set the display mode of the display 30. The display control unit 45 corresponds to output image selection means described in the claims.

  In the present embodiment, the night view camera 23 is a known near-infrared camera configured to include a lens and an imaging device such as a near-infrared sensitive CCD or CMOS (both not shown). The night view camera 23 is attached to the vehicle at a position and posture for imaging the front of the vehicle on which the vehicle-mounted display system 1 is mounted. The night view camera 23 may employ a far infrared camera instead of the near infrared camera. The night view camera 23 corresponds to the imaging device described in the claims, and the night vision image captured by the night view camera 23 includes the front image, the forward vision improvement image, and the night vision described in the claims. Corresponds to an image.

  In the present embodiment, the projector 24 is a known projector that irradiates near-infrared rays toward the imaging range of the night-view camera 23 because the night-view camera 23 is configured by a near-infrared camera. In addition, when a far-infrared camera is employ | adopted as the night view camera 23, this light projector 24 may be abbreviate | omitted.

  The night view camera 23 and the projector 24 are connected to the control unit 21. When a signal indicating the night vision image output mode is input as the image output mode information to the control unit 21 (that is, the night vision image output mode is selected), the control unit 21 starts irradiating the projector 24 with near infrared rays. And instructing the night view camera 23 to start imaging. Since the night-view image output mode is frequently selected at night, the night-view camera 23 captures a night-vision image with an improved front view at night as a front view improved image. The night view camera 23 outputs the night vision image thus captured to the control unit 21. When a night vision image is input from the night view camera 23, the control unit 21 outputs the input night vision image to the display control device 40. Incidentally, the night vision image is composed of a gray scale image including intermediate colors in addition to white and black.

  The visible light camera 25 is a known visible light camera configured to include a lens and an imaging device such as a visible light sensitive CCD or CMOS (both not shown). Similarly to the night view camera 23, the visible light camera 25 is also attached to the vehicle at a position and posture for imaging the front of the vehicle on which the in-vehicle display system 1 is mounted, and is respectively connected to the control unit 21 and the image processing unit 26. It is connected. When a signal indicating the restored image output mode is input as the image output mode information to the control unit 21 (that is, the restored image output mode is selected), the control unit 21 instructs the visible light camera 25 to start imaging. Since the frequency with which the restored image output mode is selected by the operation unit 22 is high in a situation where fog has occurred, the visible light camera 25 images the front in a situation where fog has occurred. Then, the visible light camera 25 outputs a fog image that is an image thus captured to the image processing unit 26. The visible light camera 25 corresponds to the imaging device described in the claims, and the fog image captured by the visible light camera 25 corresponds to the front image described in the claims.

  Similar to the control unit 21, the image processing unit 26 is a computer having a known CPU and a built-in memory (both not shown), and the CPU executes a program stored in the built-in memory. As a result, image processing is mainly executed. Specifically, the image processing unit 26 is connected to the visible light camera 25. When a fog image is input from the visible light camera 25, the image processing unit 26 executes known image processing for reducing the influence of the fog from the fog image. A restored image is generated. As an image processing method for reducing the influence of fog, for example, an image processing method described in Japanese Patent Application Laid-Open No. 2008-310509 may be employed. However, the image processing method is not limited to the image processing method described in this patent document, and an arbitrary image may be used. It is possible to adopt a processing method. The image processing unit 26 outputs the restored image generated in this way to the control unit 21. When the restored image is input from the image processing unit 26, the control unit 21 outputs the input restored image to the display control device 40. Note that the restored image in which the influence of fog is reduced by the image processing unit 26. Similarly to the fog image, it corresponds to the front image described in the claims. Incidentally, the fog image and the restored image are composed of grayscale images including intermediate colors in addition to white and black.

  Further, when a night vision image is input from the night view camera 23, the control unit 21 determines the presence or absence of an obstacle located in the input night vision image. When the control unit 21 determines that there is an obstacle located in the night vision image, the control unit 21 outputs obstacle detection information, which is a signal indicating the fact, to the display control device 40. Similarly, when a restored image is input from the image processing unit 26, the control unit 21 determines whether there is an obstacle located in the input restored image. When the control unit 21 determines that there is an obstacle located in the restored image, the control unit 21 outputs obstacle detection information, which is a signal indicating the fact, to the display control device 40. As a method for determining the presence or absence of an obstacle located in a night vision image or a restored image, for example, a method described in Japanese Patent Application Laid-Open No. 2007-159036 may be adopted, but the method described in this patent document Any method can be employed without being limited to the above. Moreover, the obstacle located in the front view improvement image is an obstacle to which the driver of the vehicle on which the vehicle-mounted display system 1 is mounted, for example, a pedestrian or the like. Further, the front view improvement image generation device 20 corresponds to the obstacle detection device described in the claims. Incidentally, in the present embodiment, the control unit 21 determines the presence or absence of an obstacle located in the night vision image or the restored image, but determines the presence or absence of an obstacle located in the fog image. Also good.

  Next, the configuration and function of the display 30 and the configuration and function of the display control device 40 will be described with reference to FIG.

  The display 30 is configured by, for example, a TFT touch display, and is disposed at a position that is easily visible to the driver in the passenger compartment of the vehicle on which the in-vehicle display system 1 is mounted, for example, at the center of the instrument panel of the vehicle. . The display 30 has a rectangular display area (for example, “640 × 480 [dots]”), and is connected to the display control device 40 to be controlled. The display area of the display 30 is not limited to “640 × 480 [dots]”, but can be appropriately changed as necessary, such as “480 × 480 [dots]” and “640 × 320 [dots]”. As will be described later with reference to FIGS. 5 to 7, the display 30 can display a map image and a front view improvement image in “two” display areas A <b> 1 and A <b> 2 in which the entire display area A is divided. The map image and the information providing image (branch point enlarged image) can be displayed on each of the “two” display areas A1 and A2 obtained by dividing the entire display area A, and the front of the entire display area A Either the visibility improving image or the map image can be switched to display either one. The display 30 corresponds to the display described in the claims.

 The display control device 40 is connected to the route guidance device 10, the front view improvement image generation device 20, and the display 30. The display control device 40 is a computer having a known CPU and a built-in memory (both not shown), and the CPU implements various functions by executing programs stored in the built-in memory. ing. Hereinafter, the display control device 40 includes, as functional units that realize various functions, a forward view improvement image acquisition unit 41, a map image acquisition unit 42, an information providing image acquisition unit 43, an obstacle detection information acquisition unit 44, and display control. The description will be made assuming that the unit 45 is included.

  The front view improvement image acquisition unit 41 is connected to the front view improvement image generation device 20 (specifically, the control unit 21) and the display control unit 45. When a night vision image is input from the front vision improvement image generation device 20, the front vision improvement image acquisition unit 41 acquires the input night vision image as a front vision improvement image and displays the acquired night vision image. Output to the controller 45. Further, when a restored image is input from the forward vision improved image generation device 20, the forward view improved image acquisition unit 41 acquires the input restored image as a forward view improved image, and performs display control of the acquired restored image. To the unit 45. Further, when the output image selection operation image is input from the front view improvement image generation apparatus 20, the front view improvement image acquisition unit 41 outputs the input output image selection operation image to the display control unit 45. The front view improvement image acquisition unit 41 corresponds to the front view improvement image acquisition unit and the output image selection unit described in the claims.

  The map image acquisition unit 42 is connected to the route guidance device 10 (specifically, the control unit 11) and the display control unit 45. When a “map image including a route” or a “map image including a current location” is input from the route guidance device 10, the map image acquisition unit 42 acquires the map images and displays the acquired map images as a display control unit 45. Output to. When the route guidance operation image is input from the route guidance device 10, the map image acquisition unit 42 outputs the input route guidance operation image to the display control unit 45. In addition, this map image acquisition part 42 is corresponded to the map image acquisition means as described in a claim.

  The information providing image acquisition unit 43 is connected to the route guidance device 10 (specifically, the control unit 11) and the display control unit 45. When the information providing image is input from the route guidance device 10, the information providing image acquisition unit 43 acquires the information providing image and outputs the acquired information providing image to the display control unit 45. The information providing image acquisition unit 43 corresponds to the information providing image acquisition unit described in the claims.

  The obstacle detection information acquisition unit 44 is connected to the front view improvement image generation device 20 (specifically, the control unit 21) and the display control unit 45. When the obstacle detection information acquisition unit 44 receives the obstacle detection information from the front vision improvement image generation device 20, the obstacle detection information acquisition unit 44 outputs the input (acquired) obstacle detection information to the display control unit 45. The obstacle detection information acquisition unit 44 corresponds to the obstacle detection information acquisition unit described in the claims.

  The display control unit 45 is connected to the display 30, and includes a map image acquired from the route guidance device 10, an information providing image, a route guidance operation image, a night vision image acquired from the front view improvement image generation device 20, The restored image, the output image selection operation image, and the like are displayed in the display area of the display 30. The display control unit 45 corresponds to the display control means described in the claims.

  The display control unit 45 reads a plurality of display mode selection operation images stored in the built-in memory or the like, and displays the read display mode selection operation images in the display area of the display 30. The plurality of display mode selection operation images are respectively associated with a plurality of display modes of the display control device 40 (“forward visibility improving image display mode”, “combination mode”, and “map image display mode”).

  Then, when one of the plurality of display mode selection operation images is touched by the user of the in-vehicle display system 1, display mode information which is display mode information associated with the touched display mode selection operation image. Is input to the display control unit 45. The display control unit 45, based on the image output mode information, and the input display mode information, a night vision image, a restored image, a map image, an information providing image, and the like Is displayed in the display area of the display 30.

  Here, with reference to FIG. 5, a case will be described in which the “front view improved image display mode” is selected as the display mode. In this case, when the front view improvement image is input from the front view improvement image generation device 20 (that is, the front view improvement image acquisition unit 41 acquires the front view improvement image), the display control unit 45 displays on the display 30. The acquired forward view improvement image is displayed over the entire area A. Then, the display control unit 45 receives the information providing image from the route guidance device 10 while displaying the forward visibility improving image over the entire display area A of the display 30 (that is, obtaining the information providing image). When the unit 44 acquires the information providing image), the transmission image of the acquired information providing image is superimposed on the front view improving image (that is, the acquired information providing image is displayed on the front view improving image). The image is displayed in a semi-transparent manner.)

  Further, with reference to FIG. 6, a case where “combination mode” is selected as the display mode will be described. In this case, the display control unit 45 divides the display area A of the display 30 into left and right, and a map image is input from the route guidance device 10 (that is, the map image acquisition unit 42 acquires a map image). The acquired map image is displayed in the left display area A1 of the divided display areas A, and the forward view improvement image is input from the forward view improvement image generation device 20 (that is, the forward view improvement image acquisition unit). 41 obtains a forward view improvement image), the obtained forward view improvement image is displayed in the right display region A2 of the divided display regions A. Further, the display control unit 45 receives the information providing image from the route guidance device 10 while displaying the forward visibility improving image on the display area A2 of the display 30 (that is, the information providing image main city). When the unit 43 acquires the information providing image), the transmission image of the acquired information providing image is superimposed and displayed on the front view improving image displayed in the display area A2 (that is, on the front view improving image). In addition, the information providing image is displayed in a translucent manner in a superimposed manner).

  A case where “map mode” is selected as the display mode will be described with reference to FIG. In this case, when a map image is input from the route guidance device 10 (that is, the map image acquisition unit 42 acquires a map image), the display control unit 45 displays the acquired map image over the entire display area A. (See FIG. 7A). And while the display control part 45 is displaying the acquired map image over the whole display area A of the display 30, the below-mentioned branch point which is one of the information provision images from the route guidance apparatus 10 is shown. When an enlarged image is input (that is, when the information providing image acquisition unit 43 acquires a branch point enlarged image), the display area A of the display 30 is divided into left and right, and the left of the divided display areas A is displayed. The map image displayed on the entire display area A is reduced and displayed on the display area A1, and the acquired branching point enlarged image is displayed on the right display area A2 of the divided display area A. (See FIG. 7B).

  Note that when the “image output stop mode” is selected as the image output mode of the front view improvement image generation apparatus 20, the front view improvement image is not input to the display control unit 45. Therefore, even if the “front view improved image display mode” or the “combination mode” is selected as the display mode of the display control device 40, the front view improved image is not displayed. Therefore, when the “image output stop mode” is selected as the image output mode of the front view improvement image generation device 20, the display control device 40 outputs an output image associated with the “front view improvement image display mode”. By not displaying the selection operation image and the output image selection operation image associated with the “combination mode” in the display area A of the display 30, the display mode of the display control device 40 is “front view improved image display mode” or “combination use”. Make sure that "Mode" is not selected. Therefore, when the user of the in-vehicle display system 1 selects the “image output stop mode” as the operation mode of the front view improvement image generation device 20, the user selects only the “map mode” as the display mode of the display control device 40. be able to. The display control device 40 automatically selects “map mode” as the display mode of the display control device 40 when “image output stop mode” is selected as the image output mode of the front view improvement image generation device 20. May be selected.

  Further, when the “night vision image output mode” or the “restored image output mode” is selected as the image output mode of the front view improvement image generation device 20, the front view improvement image is input to the display control device 40. . However, when the “map mode” is selected as the display mode of the display control device 40, the front view improvement image input from the front view improvement image generation device 20 is not displayed. Therefore, the display control device 40 associates with the “map mode” when “night vision image output mode” or “restored image output mode” is selected as the image output mode of the forward vision improvement image generation device 20. By not displaying the displayed display mode selection operation image in the display area A of the display 30, the “map mode” is not selected as the display mode of the display control device 40. Therefore, when the user of the in-vehicle display system 1 selects “night vision image output mode” or “restored image output mode” as the image output mode of the front view improvement image generation device 20, the display of the display control device 40 is displayed. As a mode, only “front-view improvement image display mode” or “combination mode” can be selected.

  Here, the information providing image stored in the storage unit 12 of the route guidance apparatus 10 will be described with reference to FIG. In the present embodiment, the storage unit 12 has, for example, “branch point enlarged image”, “course character string image”, “arrow image”, “remaining distance character string image”, “estimated arrival time” as information providing images. “7 types” of information providing images such as “character string image”, “simplified map image”, and “statutory speed limit image” are stored. FIG. 8 shows a display example in which the transmission images of these information providing images (excluding the branch point enlarged image) are superimposed on the night vision image.

  The “branch point enlarged image” is an image composed of a road at a branch point on the route and an arrow indicating the course direction. The “branch point enlarged image” is not shown in FIG. The route guidance device 10 is in the case of guiding a route to a destination, and the current location has reached a predetermined area with reference to a branch point on the route (for example, the current location is centered on a branch point on the route). When a circular area having a radius of “300 [m]” is reached, the “branch point enlarged image” related to the branch point is read from the storage unit 12 and the read “branch point enlarged image” is displayed. Output to the device 40. When the display mode is the “map mode”, the display control device 40 displays the “branch point enlarged image” input from the route guidance device 10 in the display area A2 of the display 30 (see FIG. 7). .

  The “course character string image” is an image of a character string that refers to the direction to go, such as “next intersection is going straight”, “next intersection is turning right”, and “next intersection is turning left”. The “arrow image” is a “straight arrow image” that extends from the bottom to the top at the center in the left-right direction of the display area, and the “right image” that extends from the bottom to the right at the center in the left-right direction of the display area. An arrow image indicating a direction to be advanced, such as a “turning arrow image” and a “left turning arrow image” extending from the lower side to the left at the center in the left-right direction of the display area. When the route guidance device 10 is guiding a route to a destination and the current location reaches the predetermined area with reference to a branch point on the route, the “route character string related to the branch point” The “image” and the “arrow image” are read from the storage unit 12, and the read “course character string image” and “arrow image” are output to the display control device 40. Then, when the display mode is the “front view improved image display mode”, the display control device 40 has the display mode set to the “combined mode” on the front view improved image displayed in the display area A of the display 30. In this case, the transmitted images of the “character string image” and the “arrow image” input from the route guidance device 10 are superimposed and displayed on the forward visibility improving image displayed in the display area A2 of the display 30. .

  The “remaining distance character string image” is an image of a character string that refers to the remaining distance on the route to the destination, such as “35 km to the destination”. The “estimated arrival time character string image” is a character string image referring to the estimated arrival time at the destination, such as “65 minutes to the destination”. The “simplified map image” is a map image that is simplified over a wider area than the map image displayed in the display area A or the display area A1. When the route guidance device 10 guides a route to the destination, the “simplified map image”, “remaining distance character string image”, and “arrival predicted time character string image” stored in the storage unit 12. ", And the read" simplified map image "," remaining distance character string image ", and" arrival predicted time character string image "are output to the display control device 40. Then, when the display mode is the “front view improved image display mode”, the display control device 40 has the display mode set to the “combined mode” on the front view improved image displayed in the display area A of the display 30. The “simplified map image”, “remaining distance character string image”, and “arrival” input from the route guidance device 10 on the forward view improvement image displayed in the display area A2 of the display 30. The transparent images of the “predicted time character string image” are superimposed and displayed. Further, when the display mode is the “map mode”, the display control device 40 displays the map on the map image displayed in the display area A of the display 30 in a superimposed manner.

  The “statutory speed limit image” is an image imitating a road sign indicating the legal speed limit of the road on which the vehicle on which the in-vehicle display system 1 is mounted is traveling. When the current location is detected, the route guidance device 10 reads the “statutory speed limit image” related to the current location from the storage unit 12 and outputs the read “legal speed limit image” to the display control device 40. Then, when the display mode is the “front view improved image display mode”, the display control device 40 displays the display mode of the display 30 on the front view improved image displayed in the display area A of the display 30. In the “combination mode”, the transmission image of the “statutory speed limit image” input from the route guidance device 10 is superimposed and displayed on the forward view improvement image displayed in the display area A2 of the display 30.

  In the present embodiment, the display control unit 45 uses a known alpha blending technique to superimpose and display a transparent image of the information providing image on the front view improvement image, that is, information on the front view improvement image. The image for provision is displayed in a translucent manner. Incidentally, the alpha blending technique designates any value from “0.0” to “1.0” as an alpha value of an image. When the display control unit 45 designates “0.0” as the alpha value, the transparent image of the information providing image for which the alpha value is designated becomes completely transparent. When the display control unit 45 designates “1.0” as the alpha value, the transmission image of the information providing image designated with the alpha value becomes completely opaque. Therefore, the smaller the alpha value, the greater the transparency of the transparent image of the information providing image, and the larger the alpha value, the smaller the transparency of the transparent image of the information providing image.

  Further, in the present embodiment, when the display control unit 45 acquires a signal indicating that there is an obstacle located in the front image from the obstacle detection information acquisition unit 44, the information providing image is not emphasized. In other words, the transparent image of the information providing image is superimposed and displayed on the front view improvement image so as not to be noticeable, while the obstacle detection information acquisition unit 44 has an obstacle located in the front image. When the signal is not acquired, the transmission image of the information providing image is superimposed and displayed on the front view improvement image so that the information providing image is emphasized, in other words, so as to stand out.

  Specifically, the display control device 40 determines whether the image output mode of the front view improvement image generation device 20 is the night vision image output mode or the transmission image of the information providing image (excluding the “branch point enlarged image”). In the restored image output mode and when the obstacle detection information is not input from the forward view improvement image generation device 20, a predetermined value (for example, “0. By specifying a value (for example, “0.7”, etc.) larger than a certain value (for example, “0.7”) (ie, making it dark semitransparent) and making the transparent image of the information providing image a color image The image is displayed in a semi-transparent manner so as to stand out on the night vision image or the restored image.

  Further, the display control device 40 sets the image output mode of the front vision improvement image generation device 20 to the night vision image output mode or the restored image output for the equivalent image of the information providing image (excluding the “branch point enlarged image”). When the obstacle detection information is input from the forward view improvement image generation device 20 in the mode, the alpha value of the transmission image of the information providing image is a predetermined value (for example, “0.5” or the like). By specifying a value (for example, “0.3”, etc.) smaller than (a constant value of the image) (that is, thin translucent) and making the transmission image of the information providing image a grayscale image, night vision It is displayed in a semi-transparent manner so as not to stand out on the image or the restored image.

  In the present embodiment, a fixed value such as “0.5” is adopted as the predetermined value, but the present invention is not limited to this. In addition, for example, the predetermined value is increased as the brightness of the front vision improved image is increased, while the predetermined value is decreased as the brightness of the front view improved image is decreased. May be set. In short, when the obstacle detection information is input from the front view improvement image generation device 20, the display control unit 45 compares it with the case where the obstacle detection information is not input from the front view improvement image generation device 20. Thus, by reducing the alpha value of the transmitted image of the information providing image (excluding the “branch point enlarged image”) (that is, increasing the transparency), the image is not conspicuous on the night vision image or the restored image. The image may be displayed in a semi-transparent manner.

  In the present embodiment, the display control unit 45 improves the forward visibility when the information providing image other than the arrow image and the branching point enlarged image is input from the route guidance device 10 among the information providing images. A transparent image of the information providing image is displayed above the vanishing point of the image. In addition, when the arrow image is input from the route guidance device 10 among the information providing images, the display control unit 45 displays a transmission image of the arrow image below the vanishing point of the forward visibility improving image.

  Specifically, since the vanishing point of the forward visibility improving image is often located at the approximate center of the display area of the display 30, the display control unit 45 displays a transparent image of the information providing image as follows. . In other words, the display control unit 45 places the transparent image of the path character string image among the information providing images above the vanishing point at the center in the left-right direction of the display area A or the display area A2 (this embodiment). (In this form, it is displayed so that it is located at the upper end). The display control unit 45 also displays the display area A or the display image of the “legal speed limit image”, “remaining distance character string image”, and “arrival predicted time character string image” among the information providing images. It is displayed so as to be located above the vanishing point on the left side of the center in the left-right direction of the area A2 (at the left end in the present embodiment). Further, the display control unit 45 transmits the “simplified map image” of the information providing image to the right of the center of the display area A or the display area A2 in the left-right direction (in the present embodiment, It is displayed so that it is located above the vanishing point (at the right end). Also, the display control unit 45 displays the equivalent image of the “arrow image” in the information providing image so as to be positioned below the vanishing point at the center in the left-right direction of the display area A or the display area A2.

  Here, the reason why the position where the display control unit 45 superimposes and displays on the front view improvement image is changed according to the type of the transmission image of the information providing image is as follows. That is, the obstacle detected by the front view improvement image generation apparatus 20 is often located below the vanishing point of the front view improvement image. Therefore, when the transmitted image of the information providing image other than the branch point enlarged image and the arrow image is displayed below the vanishing point of the forward visibility improving image, the obstacle becomes difficult to see by the information providing image, and the in-vehicle display system There is a possibility that one user may be prevented from recognizing an obstacle. Therefore, the display control unit 45 displays the transmission image of the information providing image other than the branch point enlarged image and the arrow image above the vanishing point of the forward visibility improving image. However, the transparent image of the arrow image is displayed below the vanishing point of the forward visibility improved image. Since the road is often located below the vanishing point of the forward visibility improvement image, the user of the in-vehicle display system 1 can display the shape of the road by superimposing the transparent image of the arrow image below the vanishing point. It becomes possible to visually recognize the information related to the route and the information related to the course at a time. In addition, it is easier for the user of the in-vehicle display system 1 to display below the vanishing point of the front view improvement image than to display above.

  The display processing S11 to S13 by the display control device 40 of the present embodiment described above will be described with reference to FIGS. FIG. 9 is a flowchart illustrating an example of display processing executed by the display control device 40 when the image output mode of the front vision improvement image generation device 20 is the night vision image output mode. FIG. 10 is a flowchart illustrating an example of display processing executed by the display control device 40 when the image output mode of the front view improvement image generation device 20 is the restored image output mode. FIG. 11 is a flowchart illustrating an example of display processing executed by the display control device 40 when the image output mode of the front view improvement image generation device 20 is the image output stop mode. The display control device 40 repeatedly executes these display processes S11 to S13.

  When the night vision image output mode is set as the image output mode of the front view improvement image generation device 20, the display control device 40 starts executing the display process S11 shown in FIG. The display control device 40 first determines whether or not the display mode of the display control device 40 is the forward visibility improved image display mode as the determination processing in step S111. Here, when it is determined that the display mode is the forward view improvement image display mode (“Yes” in the determination process of step S111), the display control device 40 is input from the front view improvement image generation device 20 as the process of the subsequent step S112. The night vision image is displayed over the entire display area A of the display 30 (see FIG. 5). When the night vision image is displayed, the display control device 40 proceeds to the determination process in the subsequent step S114.

  On the other hand, when it is not determined that the display mode of the display control device 40 is the forward visibility improved image display mode in the determination processing of step S111 ("No" in the determination processing of step S111), that is, the display control device When the display mode 40 is the combined mode, the display control device 40 proceeds to the subsequent step S113. In step S113, the display control device 40 divides the display area A of the display 30 into left and right, and when a map image is input from the route guidance device 10, the left display area A1 of the divided display areas A. The inputted map image is displayed at the same time, and when the forward view improvement image is inputted from the forward view improvement image generation device 20, the inputted night vision is displayed in the right display region A2 of the divided display regions A. An image is displayed (see FIG. 6). When the map image and the night vision image are displayed, the display control device 40 proceeds to the determination process in the subsequent step S114.

  In step S114, the display control device 40 determines whether an information providing image (excluding a branch point enlarged image) is input from the route guidance device 10. Here, when the information providing image is not input (“No” in the determination process of step S114), the display control device 40 ends the display process of step S11 as it is. On the other hand, when the information providing image is input (“Yes” in the determination process in step S114), the display control device 40 proceeds to the subsequent determination process in step S115.

  In step S115, the display control device 40 determines whether obstacle detection information is input from the route guidance device 10. Here, when the obstacle detection information is not input (“No” in the determination process in step S115), the display control device 40 performs an information providing image (excluding the branch point enlarged image) as the subsequent process in step S116. Is superimposed and displayed on the night vision image displayed in the display area A or the display area A2 of the display 30 in a color image and in a deep translucent state. Then, when the process of step S116 is completed, the display control device 40 ends the display process of step S11 as it is.

  On the other hand, when obstacle detection information is input in the determination process of step S115 (“Yes” in the determination process of step S115), the display control device 40 performs an information providing image (branch) as the subsequent process of step S117. Are displayed in a gray scale image and in a thin translucent manner on the night vision image displayed in the display area A or the display area A2 of the display 30. Then, when the process of step S117 is completed, the display control device 40 ends the display process of step S11 as it is.

  In addition, when the restored image output mode is set as the image output mode of the front view improvement image generation device 20, the display control device 40 starts executing the display process S12 illustrated in FIG. The display control device 40 first determines whether or not the display mode of the display control device 40 is the forward visibility improved image display mode as the determination processing in step S121. Here, when it is determined that the display mode is the forward view improvement image display mode (“Yes” in the determination process of step S121), the display control device 40 is input from the front view improvement image generation device 20 as the process of the subsequent step S122. The restored image is displayed over the entire display area A of the display 30 (see FIG. 5). When the restored image is displayed, the display control device 40 proceeds to the determination process in the subsequent step S124.

  On the other hand, when it is not determined that the display mode of the display control device 40 is the forward visibility improved image display mode in the determination processing of step S121 ("No" in the determination processing of step S121), that is, the display control device When the display mode 40 is the combination mode, the display control device 40 proceeds to the subsequent step S123. When the process proceeds to step S123, the display control device 40 divides the display area A of the display 30 into left and right, and when a map image is input from the route guidance device 10, the display on the left side of the divided display area A is displayed. When the input map image is displayed in the area A1, and the forward view improvement image is input from the forward view improvement image generation apparatus 20, the input image is input to the right display area A2 of the divided display areas A. A restored image is displayed (see FIG. 6). When the map image and the restored image are displayed, the display control device 40 proceeds to the determination process in the subsequent step S124.

  In step S124, the display control device 40 determines whether an information providing image (excluding the branch point enlarged image) is input from the route guidance device 10. Here, when the information providing image is not input (“No” in the determination process in step S124), the display control device 40 ends the display process in step S12 as it is. On the other hand, when the information providing image is input (“Yes” in the determination process in step S124), the display control device 40 proceeds to the subsequent determination process in step S125.

  In step S125, the display control device 40 determines whether obstacle detection information is input from the route guidance device 10. Here, when the obstacle detection information is not input (“No” in the determination process of step S125), the display control device 40 performs an information providing image (excluding the branch point enlarged image) as the subsequent process of step S126. Is superimposed and displayed on the restored image displayed in the display area A or the display area A2 of the display 30 in a color image and in a deep translucent state. Then, when the process of step S126 is completed, the display control apparatus 40 ends the display process of step S12 as it is.

  On the other hand, when obstacle detection information is input in the determination process of step S125 (“Yes” in the determination process of step S125), the display control device 40 performs an information providing image (branch) as the subsequent process of step S127. Are displayed in a gray scale image and in a thin translucent manner on the restored image displayed in the display area A or the display area A2 of the display 30. When the process of step S127 is completed, the display control device 40 ends the display process of step S12 as it is.

  Further, when the image output stop mode is set as the image output mode of the front view improvement image generation device 20, the display control device 40 starts executing the display process S13 shown in FIG. The display control device 40 displays the map image input from the route guidance image 10 over the entire display area A of the display 30 as the determination process in step S132 (see FIG. 7). When the map image is displayed, the display control device 40 proceeds to the determination process in the subsequent step S134.

  In step S134, the display control device 40 determines whether a branch point enlarged image is input from the route guidance device 10. Here, when the branch point enlarged image is not input (“No” in the determination process of step S134), the display control device 40 ends the display process of step S13 as it is. On the other hand, when the branch point enlarged image is input (“Yes” in the determination process of step S134), the display control device 40 proceeds to the subsequent process of step S136.

  When the process proceeds to step S136, the display control device 40 divides the display area A of the display 30 into left and right, and when a map image is input from the route guidance device 10, the left display of the divided display areas A is displayed. When the input map image is displayed in the area A1 and a branching point enlarged image is input from the forward view improvement image generating apparatus 20, the input is input to the right display area A2 of the divided display areas A. A branch point enlarged image is displayed (see FIG. 7). When the map image and the branch point enlarged image are displayed, the display control device 40 ends the process of step S13 as it is.

In the in-vehicle display system 1 of the present embodiment described above, the display control device 40 is displayed on the display area A of the display 30 while at least the front view improvement image among the front view improvement image and the map image is displayed. Based on the acquisition of the information providing image, the information providing image is displayed in a semi-transparent manner on the forward view improvement image. Since the information providing image is displayed in a semi-transparent manner on the front view improving image, the first display device in which the display region of the front view improving image is reduced in order to secure the display region of the information providing image. Unlike the above, there is no need to reduce the display area of the forward view improvement image. Therefore, the visibility of the information providing image does not deteriorate. In addition, since the information providing image is displayed in a translucent manner on the front view improving image, it is necessary to prepare a display for displaying the front view improving image and a display for displaying the information providing image. Unlike a two-display device, only one display is required. Therefore, the user can acquire information from both the forward view improvement image and the information providing image by looking at one display, and the user needs extra time for focusing. Will disappear. Therefore, it is possible to display both the front view improvement image and the information providing image on one display while preventing the visibility of the front view improvement image from being lowered.
(Other embodiments)
Note that the display control device and the in-vehicle display system according to the present invention are not limited to the configurations exemplified in the above-described embodiment, and may be implemented with various modifications without departing from the spirit of the present invention. Is possible. In other words, for example, the following embodiment can be implemented by appropriately changing the above embodiment.

  In the above-described embodiment, the forward vision improvement image generation device 20 generates a restored image in which the influence of fog is reduced from the fog image in addition to the night vision image as the forward vision improvement image, but only the night vision image is generated. Alternatively, the image is not limited to the restored image, and may be another image with improved front view as long as the image improves the front view.

  In the above-described embodiment, the front view improvement image generation device 20 generates a grayscale image as the front view improvement image (that is, the night vision image and the restored image). An image may be generated. In the case of generating a color image as the forward view improvement image, the display control device 40 displays the information providing image different from the hue of the forward view improvement image when the obstacle detection information is not input from the route guidance device 10. It is preferable that the hue is superimposed and displayed on the front view improvement image in a hue in a dark translucent manner. When obstacle detection information is input from the route guidance device 10, the information providing image is displayed in the same hue as the hue of the front view improvement image It is good to superimpose and display on a forward view improvement image by thin translucent.

  Further, as shown in FIG. 12 as a diagram corresponding to FIG. 8, when obstacle detection information is input from the route guidance device 10, the display control device 40 is an obstacle that is a frame surrounding the obstacle. A detection frame may be displayed. Thereby, the user of the in-vehicle display system 1 can easily recognize the obstacle detected by the route guidance device 10.

  Further, in the above embodiment, as shown in the previous FIG. 9 (processing of steps S114 to 117), the display control device 40, when obstacle detection information is not input from the route guidance device 10, In order for all the information providing images (excluding the branch point enlarged image) to stand out, all of the information providing images are superimposed and displayed on the night vision image in a dark translucent color image. When the obstacle detection information is input from, all the information providing images (except for the branching point enlarged images) are made thin and translucent in grayscale images so that all the information providing images (except for the enlarged branch point images) are not conspicuous. However, it is not limited to this. As shown in FIG. 13 as a diagram corresponding to the previous FIG. 8 or FIG. 12, the display control device 40 displays the information providing image (branch) when the obstacle detection information is input from the route guidance device 10. Other information-providing images other than simplified map images and course character string images (except for point-enlarged images) are made very thin and translucent in grayscale images so that they are not conspicuous Thus, the image may be displayed superimposed on the night vision image, or may not be displayed superimposed on the night vision image. As a result, it is possible to prevent the obstacle from being obstructed as much as possible while leaving the minimum route guidance function as much as possible.

  Moreover, in the said embodiment, the map image and the image for information provision which are images different from this map image and a front view improvement image, and an image for providing information are produced | generated, These produced | generated maps Although the route guidance device 10 that guides the route using the image and the information providing image is employed, the route guidance device 10 is not limited thereto. Any information providing apparatus can be employed as long as it is an information providing apparatus that generates an information providing image that is an image for providing information such as weather related information as well as information on a route.

DESCRIPTION OF SYMBOLS 1 ... Car-mounted display system, 10 ... Route guidance apparatus, 11 ... Control part, 12 ... Memory | storage part, 13 ... GPS receiving part, 14 ... Audio | voice output part, 20 ... Front vision improvement image generation apparatus, 21 ... Control part, 22 ... Operation unit, 23 ... Night view camera (imaging device), 24 ... Projector, 25 ... Visible light camera (imaging device), 26 ... Image processing unit, 30 ... Touch display (display), 40 ... Display control device, 41 ... Front Visibility improvement image acquisition unit (forward visibility improvement image acquisition unit), 42 ... map image acquisition unit (map image acquisition unit), 43 ... information providing image acquisition unit (information providing image acquisition unit), 44 ... obstacle detection information Acquisition unit (obstacle detection information acquisition unit), 45... Display control unit (display control unit).

Claims (16)

A forward view improvement image acquisition means for acquiring the forward view improvement image from a forward view improvement image generation device for generating a forward view improvement image with improved view in front of the vehicle;
Information providing image acquisition means for acquiring the information providing image from an information providing device that generates an information providing image that is an image for providing information;
Display control for superimposing and displaying a transparent image of the information providing image on the front view improving image based on the information providing image being acquired while the front view improving image is displayed on the display And a display control apparatus. The display control device according to claim 1,
The information providing apparatus that generates a map image and an image different from the map image and the forward view improvement image as the information providing image, and guides the route using the generated map image and the information providing image. A map image acquisition means for acquiring the map image from the route guidance device as:
The display control means provides the information while at least the front view improvement image of the front view improvement image and the map image is displayed on the display capable of displaying the front view improvement image and the map image. A display control apparatus that superimposes and displays a transmission image of the information providing image on the front view improvement image based on the acquisition of the image for use. The display control device according to claim 2,
The display control device, wherein the display control unit superimposes and displays the transmission image of the information providing image above the vanishing point of the front view improvement image. The display control device according to claim 3,
The information providing image includes an arrow image that is an image of an arrow indicating a direction to be advanced,
The display control unit superimposes and displays a transparent image of the information providing image above the vanishing point of the front view improved image, and the transparent image of the arrow image in the information providing image is the front view. A display control device, characterized by being superimposed and displayed below a vanishing point of an improved image. The display control device according to claim 4,
The display control means outputs from the route guidance device that outputs the arrow image to the display control device when the current location of the vehicle on which the display control device is mounted reaches a predetermined area with respect to a road branch point. A display control apparatus, wherein the transmission image of the arrow image is superimposed and displayed on the forward visibility improving image based on the acquired arrow image. In the display control device according to any one of claims 3 to 5,
The information providing image includes a course character string image that is an image of a character string that refers to a direction to be advanced,
The display control means outputs the route character string image to the display control device when a current location of a vehicle on which the display control device is mounted reaches a predetermined area with respect to a road branch point. A display control apparatus, wherein a transparent image of the course character string image is superimposed and displayed on the front view improvement image based on the acquisition of the course character string image output from the. In the display control device according to any one of claims 2 to 6,
Based on a front image that is an image captured by an imaging device that captures a front image, it is determined whether there is an obstacle located in the front image, and it is determined that there is an obstacle located in the front image. The obstacle detection information acquisition means for acquiring the obstacle detection information from the obstacle detection device that outputs the obstacle detection information that is a signal indicating the fact to the display control device,
The display control means, when the obstacle detection information acquisition means does not acquire the obstacle detection information, compared with the case where the obstacle detection information acquisition means acquires the obstacle detection information, A display control apparatus that superimposes and displays a transparent image of the information providing image on the front view improvement image so that the transparent image of the information providing image is emphasized. In the display control device according to any one of claims 2 to 6,
When it is determined that there is an obstacle located on the route in the front image based on the route guided by the route guidance device and a front image that is an image captured by an imaging device that captures an image ahead. The obstacle detection information acquisition means for acquiring the obstacle detection information from the obstacle detection device that outputs the obstacle detection information that is a signal indicating the fact to the display control device,
The display control means, when the obstacle detection information acquisition means does not acquire the obstacle detection information, compared with the case where the obstacle detection information acquisition means acquires the obstacle detection information, A display control apparatus that superimposes and displays a transparent image of the information providing image on the front view improvement image so that the transparent image of the information providing image is emphasized. The display control device according to claim 7 or 8,
The display control means, when the obstacle detection information acquisition means does not acquire the obstacle detection information, compared with the case where the obstacle detection information acquisition means acquires the obstacle detection information, By reducing the transparency of the transparent image of the information providing image, the transparent image of the information providing image is superimposed on the front view improving image so that the transparent image of the information providing image is emphasized. A display control device characterized by that. In the display control device according to any one of claims 7 to 9,
The information providing image includes a simplified map image obtained by simplifying the map image, and a course character string image that is an image of a character string that refers to a direction to proceed,
The display control means, when the obstacle detection information acquisition means does not acquire the obstacle detection information, compared with the case where the obstacle detection information acquisition means acquires the obstacle detection information, Among the information providing images, the simplified map image and the simplified map image of the information providing image are reduced by reducing the transparency of the transparent image of the information providing image other than the simplified map image and the route character string image. A display control apparatus that superimposes and displays the transparent image of the information providing image on the forward visibility improving image so that the transparent image of the information providing image other than the course character string image is emphasized. . In the display control device according to any one of claims 7 to 10,
The front view improvement image acquisition means generates a night vision image, which is a grayscale image with an improved front view at night taken by a night view camera as the imaging device, as the front view improvement image. A display control apparatus, wherein the night vision image is acquired as the forward visibility improving image from an image generation apparatus. The display control device according to claim 11,
When the obstacle detection information acquisition unit does not acquire the obstacle detection information, the display control unit is configured to provide the information on the night vision image acquired by the front view improvement image acquisition unit. A display control apparatus that displays a transparent image of an image as a color image. The display control device according to claim 11 or 12,
When the obstacle detection information acquisition unit acquires the obstacle detection information, the display control unit includes the information providing image on the night vision image acquired by the front view improvement image acquisition unit. A display control apparatus for displaying a transmission image as a gray scale image. In the display control device according to any one of claims 2 to 13,
The display control means includes the information providing image on the front view improvement image displayed on the display capable of displaying the front view improvement image and the map image in a plurality of display regions obtained by dividing the entire display region. A display control apparatus for displaying a transparent image of the image. In the display control device according to any one of claims 2 to 14,
The display control means transmits the information providing image on the front view improvement image displayed on the display capable of switching between the front view improvement image and the map image and displaying either one over the entire display area. A display control device that displays an image in a superimposed manner. A display control device according to any one of claims 1 to 15,
A forward view improvement image generation device for generating a forward view improvement image in which the forward view is improved;
An in-vehicle display system comprising: an information providing device that generates an information providing image that is an image for providing information.