JP4389173B2 - Vehicle display device - Google Patents

Description

  The present invention relates to a vehicle display device that displays a captured image in front of a vehicle during night vehicle operation and highlights an obstacle in the captured image.

  Conventional vehicles have an obstacle detection system equipped with a night vision device (night vision) to detect obstacles in front of the vehicle when driving at night and assist the driver's view at night. . The display part of the image photographed by such a night vision photographing device is provided at a position where it can be easily perceived by the driver, such as a vehicle head-up display or a meter display screen on which meters are displayed.

  However, when displaying a night vision photographed image, there are many other display items on the display device, so that the space for displaying the night vision photography image is limited, and the display area of the night vision photography image may be relatively small. There were many. In addition, simply displaying a night vision image makes it difficult for the driver to find an obstacle from the night vision image, and it takes time to guess where it is on the actual landscape. There was also a problem.

  The present invention has been made in view of the above problems, and provides a vehicle display device that enables an obstacle to be easily found from a night-vision photographed image displayed on the screen of the display device. Objective.

In order to solve the above-described problem, the vehicle display device of the present invention is a vehicle display device including display means capable of displaying a night vision image in front of the vehicle, and is a fault existing in front of the vehicle in the night vision image. An obstacle identifying means for identifying an object, and when an obstacle is identified, the display means enlarges a night vision photographed image area for displaying a night vision image so as to increase the area area and Display control means for displaying a night vision image displayed before identification of the obstacle in a visual captured image area in a form in which the visual field range around the obstacle is expanded more widely. Features .

Night vision captured image area in the vehicle display device of the present invention can be assumed to be integrally displayed together with the meter image area on a common screen of the display means. According to this configuration, the meter image area and the night vision image area can be configured by a single display device, so that the hardware cost and assembly labor can be saved, and the design freedom and flexibility of the meters are flexible. It can greatly increase the sex.

  When the meter image area and the night vision image area are integrally displayed on the common screen of the image display, when the obstacle is identified, the night vision image area itself on which the obstacle is displayed is displayed on the screen. Can be enlarged. According to this configuration, when the obstacle is identified, the night vision photographed image area is enlarged, so that the driver can quickly recognize that there is an obstacle in front of the vehicle and the night vision photography image area. Since the whole is enlarged, the position of the obstacle can be recognized quickly from the screen, and the position of the obstacle on the actual scene can be quickly estimated.

  In addition, when an obstacle is identified, when the night vision image area itself on which the obstacle is displayed is enlarged on the screen, the night vision image area has a display field of view of the night vision photography image. While fixing, the aspect ratio can be enlarged to be the same as before enlargement. According to this configuration, since the night vision image area is displayed in the same range even after being enlarged, it is easier to specify the position of the obstacle.

The display control means in the display device for a vehicle of the present invention displays a plurality of meter image areas on the background of the night vision image area, and is enlarged as the night vision image area is enlarged. The night vision photographed image area may be displayed in an overlapping manner so as to hide a part of the meter image area. In the event of an emergency such as when there is an obstacle ahead of the vehicle when the vehicle is running, it is preferable for safety to give priority to notifying the presence of such an obstacle over the meter display. According to the above configuration, when an obstacle is identified, the notification of the obstacle is prioritized, the night vision image area is enlarged using the meter image area, and the driver detects the presence of the obstacle and its position. Can be easily recognized. Furthermore, the effect of notifying the presence of an obstacle is further increased by suddenly hiding the meter display that is always displayed during normal operation.

  In this case, in the meter image area, the display size and display position of the portion that is not concealed by the enlarged night vision photographed image area may be maintained unchanged from that before the night vision photography image area is magnified. it can. According to this configuration, since the position of the meter display does not change when the night vision photographed image area is displayed in an enlarged manner, when reading from the meter image area portion that is not concealed by the night vision photography image area, viewing is performed in the same manner as usual. be able to. Further, by displaying particularly important meter display information at a position that is not concealed in the night vision photographed image area, such information can be visually recognized even when the night vision photography image area is enlarged.

  As important meter display information, for example, there is vehicle speed information of a vehicle important for safe driving. In this case, the meter image area includes a vehicle speed meter image area, a part of the vehicle speed meter image area is concealed with the expansion of the night vision image area, and the night vision after the enlargement of the vehicle speed meter image area. It is possible to make the vehicle speed instruction value visible in a portion that is not hidden in the captured image area. According to this configuration, the driver can read vehicle speed information, which is display information important for safe driving, even when the night vision image area is enlarged.

  The meter image area includes a vehicle speed meter image area and an engine speed meter image area, and the night vision image area has a concealed area of the engine speed meter image area larger than the vehicle speed meter image area. Can be enlarged. In general, the vehicle speed meter and the engine speed meter are displayed in a form having a wide screen display area. Of these, the vehicle speed meter is mainly important for safe driving. According to the above configuration, when the night vision image area is enlarged, the display area of the vehicle speed meter with high importance can be made larger than the engine speed meter with low importance for safe driving, and the vehicle speed meter It becomes easy to read the vehicle speed information displayed.

Further, the display control means in the display device for a vehicle according to the present invention displays a plurality of meter image areas on the background of the night vision image area, and displays the display in at least a part of the plurality of meters. The mode is determined as a multi-mode meter having a standard display mode and a reduced display mode in which the area required for the entire display is smaller than the standard display mode, corresponding to the expansion of the night vision image area. Due to the expansion, it is Rukoto be displayed by switching the image display of the multimode meter from the standard display mode to the reduced display mode. According to this configuration, a part of the meter display that is hidden by the night vision image when the night vision image area is enlarged is reduced, and the display position is changed and displayed in an area that is not hidden by the night vision image. Therefore, the driver can see the display even when the night vision image area is enlarged. For example, the multi-mode meter that can be switched between the standard display mode and the reduced display mode can include at least one of a speed meter and a fuel meter, so that the driver can enlarge the night vision image area. It is possible to know vehicle speed information and fuel remaining amount that are important display information for safe driving.

  Further, in the multi-mode meter that can be switched between the standard display mode and the reduced display mode, the meter image area in the reduced display mode can be displayed on the background of the enlarged night vision photographed image area. Thereby, it is possible to display the meter information in a place other than the night vision image area in an easy-to-see manner. In addition, the meter image area in the reduced display mode can be displayed in an overlapping manner within the enlarged night vision photographed image area. This makes it possible to further increase the display area of the night vision image area.

  Hereinafter, an embodiment in which the vehicle display device of the present invention is applied to a vehicle meter unit will be described with reference to the drawings.

  FIG. 1 is a block diagram showing an electrical configuration of the vehicle display device of the present invention. The vehicle meter unit 1 of FIG. 1 is provided so as to be visible from the driver's seat, an operation unit 20 for performing various input operations, a night vision camera 30 capable of photographing even at night with a small amount of light, and a well-known drawing LSI 90. A display panel 100 that visually displays basic operation state information of the vehicle, a meter ECU 10 that performs display control of the display panel 100, and a body system ECU 200 to which various sensors are connected are configured.

  The display panel 100 is an image display composed of a TFT color LCD (Thin Film Transistor-Liquid Crystal Display), and is disposed to face the driver's seat of the vehicle. As shown in FIG. 2A, the display panel 100 is provided with a night-vision photographed image display section 120 having a night-vision photographed image area 121 in the center, and a meter display section 110 (night-vision) on the background. A background part of the photographed image display part) is provided. The meter display unit 110 includes a speed meter display area 101, an engine speed as a meter display area (meter image area) for displaying a speed meter, an engine speed meter, a gasoline (fuel) remaining amount meter, and a water temperature meter. A meter display area 102, a gasoline remaining amount meter display area 103, and a water temperature meter display area 104 are partitioned, and the meter images corresponding to each are displayed in color. The display panel may be another display, for example, an organic EL display, a plasma display, a field emission display, or the like as long as the same effect can be obtained. May be.

  The operation unit 20 includes a switch for starting photographing with the night vision camera 30 and a switch for adjusting the brightness of the display panel (none of which are shown). FIG. 2 shows a state in which this switch is turned on. When the switch is turned off, the night vision photographed image area 121 disappears, and the meter display unit 110 concealed there appears. Note that the switch for starting the shooting of the night vision camera 30 is not limited to a manual operation by the driver, and a switch that starts shooting when the vehicle headlight or fog light is turned on, The photographing may be started based on the fact that the detection amount of a solar radiation sensor (not shown) connected to the ECU 200 is equal to or less than a predetermined amount.

  The night vision camera 30 is a well-known camera that is mounted on a rearview mirror and photographs the front of the vehicle, and can be photographed even at night when a sufficient amount of light cannot be obtained. In this embodiment, an infrared camera that detects infrared rays emitted from an object in the field of view is used, and in addition to natural light and other external light, a vehicle headlight or fog light can be used as a light source. It has become. An image captured by the night vision camera 30 is displayed in a single color shade in the night vision image area 121 in a normal state where no obstacle is detected. In this embodiment, the image is displayed in black and white (monochrome). The arrangement position of the night vision camera 30 is not particularly limited as long as it is a position where the front of the vehicle can be photographed. Also, a radar or the like can be used as the night vision camera 30.

  The meter ECU 10 is configured as a display control unit that performs main control of meter display, and the main parts thereof are a CPU 11, a RAM 12 having a work memory 12a, a ROM 13 for storing various programs, and an input / output unit (I / O is shown in the figure). ) 15, a communication interface (displayed as IF in the figure) 16, and a non-volatile memory (displayed as external memory in the figure) 17 such as a flash memory are connected by an internal bus 14. The meter ECU 10 is connected to other ECUs such as the body ECU 200 by a serial communication bus 50 via a communication interface (reference numeral 16f is a communication buffer memory for temporarily storing transmission / reception data). is there). A sensor group for acquiring basic operation state information to be displayed on the display panel 100 is connected to the body system ECU 200. Specifically, a vehicle speed sensor 201, an engine speed sensor 202, a gasoline (fuel) remaining amount sensor 203, a water temperature sensor 204, and the like.

  The meter ECU 10 obtains basic operation state information from the sensor groups 201 to 204 via the communication bus 50, and instructs that on each corresponding master image of the meter (for example, stored in the ROM 13). Reflect the value and create drawing data for each meter (hereinafter referred to as meter drawing data). Specifically, the detected value of the vehicle speed sensor 201 is in the speed meter image, the detected value of the engine speed sensor 202 is in the engine speed meter image, the detected value of the remaining fuel sensor 203 is in the remaining fuel meter image, The detection value of the sensor 204 is reflected in the water temperature meter image and displayed in the corresponding meter display areas 101 to 104, respectively.

  The drawing LSI 90 forms an image synthesis output control unit, and night-vision image data displayed in the night-vision photographed image area 121 and each meter displayed in the meter image areas 101 to 104 of various meters of the display panel 100. The image data is received, and the image is synthesized on the graphic memory 80, the output setting value of each pixel of the display panel 100 is determined based on the image data of each area, and is output to the display panel 100. Thereby, on the display panel 100, in the normal state where no obstacle is detected, the meter image and the night vision image are integrally displayed in a display form as shown in FIG.

  In the vehicle display device of the present invention, in the ROM 13 of the meter ECU 10, in addition to the known program for creating the drawing data, an obstacle identification program 13a for detecting an obstacle from an image taken by the night vision camera 30, In the normal state, it is displayed as shown in FIG. 2 (a), and when an obstacle is detected by the obstacle identification program 13a, a night vision image area, as shown in FIG. A display panel drawing program 13b for enlarging and displaying the obstacle in the visual image area and notifying the driver of the presence of the obstacle is stored. Even if the obstacle identification program 13a is not in the meter ECU 10, it is sufficient if the obstacle ECU 13a has a system in which the meter ECU 10 can obtain the information.

  The obstacle identification program 13a identifies whether there is an obstacle in the image captured by the night vision camera 30. Obstacle data is stored in the external memory 17, and the obstacle identification program 13 a reads data of what appears to be an obstacle present in the night vision image captured by the night vision camera 30, the above obstacle data, Are compared to identify whether there is an obstacle in the night vision image.

  The external memory 17 stores a pattern of various obstacle data. For example, in the case of a “human” who can be an obstacle of a running vehicle, each pattern data of a form change that can be taken by an obstacle such as a walking pattern, a stationary pattern, a running pattern, etc. is stored. Has been. In the case of an obstacle having heat such as a human being, the heat source target is specified by an infrared camera, and the data of the target object and the obstacle data stored in the external memory 17 are compared (shape comparison). Thus, an obstacle may be identified. Obstacle detection of this embodiment is a well-known technique.

  The display panel drawing program 13b displays various meter images and night vision images taken by the night vision camera 30 on the display panel 100, and when an obstacle is detected by the obstacle identification program 13a, the obstacle is highlighted. The function is performed by the CPU 11 and functions as a display control unit. The flow of the display panel drawing program 13b will be described below using the flowchart shown in FIG.

  First, in S1, it is determined whether or not the night vision image display is in effect. This is performed based on whether or not a switch for starting shooting of the night vision camera 30 of the operation unit 20 is turned on. If it is ON, the process proceeds to S2, and it is determined in S2 whether or not the vehicle is running from the detected value of the vehicle speed meter 201. When the vehicle is stopped, the process proceeds to S5, and the captured image of the night vision camera 30 in which the presence or absence of an obstacle is determined is normally displayed as shown in FIG. If the vehicle is running, the process proceeds to S3. If no obstacle is detected by the obstacle identification program 13a, the process proceeds to S4, and the captured image of the night vision camera 30 in which the presence or absence of the obstacle is determined is displayed. The normal display is performed as shown in FIG. If an obstacle is detected in S3, the process proceeds to S4, and the obstacle is highlighted and displayed as shown in FIG. In S5, it is determined whether or not the photographing switch of the night vision camera 30 is OFF. If it is ON, S2 to S5 are repeated, and the night vision image is in the normal display state when no obstacle is detected and when the vehicle is stopped. When an obstacle is detected, the normal display state is switched to the highlighted display state in which the obstacle is highlighted. When the shooting switch of the night vision camera 30 is OFF, the program 13b is terminated.

  In this embodiment, in the normal display state, as shown in FIG. 2A, a plurality of meter display areas (meter image areas) 101 to 104 are displayed on the screen of the display panel 100 on the background of the night vision photographed image area 121. However, when the normal display state is switched to the highlighted display state, as shown in FIG. 2B, the aspect ratio is the same as that before the enlargement while fixing the display field of view of the night vision photographed image area 121. The band-shaped marking area (night-vision photographed image-emphasized marking display) 123 defined above the night-vision photographed image area 121 is changed from the same color as the background to a color different from the background. The driver is notified of the presence of the object. In addition, with the enlargement, the enlarged night vision image area 121 is displayed in an overlapping manner so as to hide a part of the meter display areas 101 to 104. At this time, the display size and the display position of the portion of the meter display areas 101 to 104 that are not concealed by the enlarged night vision photographed image area 121 are maintained unchanged from those before the night vision photography image area 121 is enlarged. In addition, the vehicle speed instruction value, the gasoline remaining amount, and the water temperature are visible in the portions of the meter display areas 101 to 104 that are not concealed by the enlarged night vision image area 121. Furthermore, the method of the image area 102 of the engine speed meter is displayed so that the background hidden area is larger than the vehicle speed meter image area 101. Further, in order to make it easier to specify the position of the obstacle in the night vision image area 121, the obstacle is marked with an obstacle marking display 122 so as to surround itself, and the obstacle itself is displayed in color. .

  In this embodiment, at least when the vehicle is stopped, switching from the normal display state to the highlighted display is prohibited. Since the vehicle itself is safe without going to an obstacle when the vehicle is stopped, in such a case, it is desirable to set the normal display state in which all other meter displays are visible and visible to the driver. . Further, for example, it is possible to eliminate unnecessary apparatus loads such as detecting and highlighting all pedestrians walking on the pedestrian crossing in front of the pedestrian crossing. This is not limited to when the vehicle is stopped, but can be applied to a low speed state in which a certain degree of safety is secured and the front can be sufficiently visually confirmed. The display switching prohibiting means for prohibiting switching from the normal display state to the highlighted display body functions by the CPU 11 executing the display panel drawing program 13b.

  As mentioned above, although the Example of this invention was described, these are only illustrations, this invention is not limited to these, A various change is possible unless it deviates from the meaning of a claim. . Hereinafter, the above embodiment will be referred to as a first embodiment, and an embodiment different from that will be described.

  FIG. 4 is a second embodiment of the present invention, and shows a highlighted state in which an obstacle is highlighted. Here, the night vision image area 121 is displayed larger than the highlighted display state of the first embodiment, and the presence of an obstacle is further emphasized to the driver. Here, the vehicle speed instruction Only the value and the remaining amount of gasoline are displayed. Of the meter display areas 101 to 104, the display dimensions and display positions of the portions not hidden by the enlarged night vision photographed image area 121 are maintained unchanged from those before the night vision photography image area 121 is enlarged.

  FIG. 5 shows a third embodiment of the present invention and shows a highlighted state in which an obstacle is highlighted. Here, the night vision image area 121 is displayed larger than the highlighted display state of the second embodiment, and the presence of an obstacle is further emphasized to the driver. In addition, the display mode is displayed at a position where the vehicle speed instruction value and the gasoline remaining amount display, which are important information during traveling, are not concealed in the enlarged night vision image area 121 (background of the enlarged night vision image area 121). It is changed and displayed in a reduced size (reduced display mode). That is, when switching from the normal display state to the highlighted display state, the vehicle speed meter display region 101a, the gasoline remaining amount meter display region 103a, and the display form thereof are changed. In this embodiment, the vehicle speed meter and the gasoline remaining amount meter are the multimode meter of the present invention.

  FIG. 6 is a fourth embodiment of the present invention and shows a highlighted state in which an obstacle is highlighted. Here, the night vision image area 121 is displayed larger than the highlighted display state of the third embodiment, and the presence of an obstacle is further emphasized to the driver. Further, the display mode is displayed at a position where the vehicle speed instruction value and the gasoline remaining amount display, which are important information during traveling, are not concealed by the enlarged night vision image area 121 (inside the enlarged night vision image area). It is displayed in a superimposed manner (reduced display mode). That is, when the normal display state is switched to the highlighted display state, the vehicle speed meter display region 101b and the display form thereof are changed. In this embodiment, the vehicle speed meter is the multi-mode meter of the present invention.

  FIG. 7 shows a fifth embodiment of the present invention, which is substantially the same as the fourth embodiment, except that the display area 101c of the vehicle speed meter is thinly formed in the lower area of the night vision image area 121 and displayed. It is displayed in a band shape so as to hide the lower side of the image.

  FIG. 8 is a sixth embodiment of the present invention and shows a highlighted state in which an obstacle is highlighted. Here, only the obstacle is displayed enlarged compared to the normal display state, and the driver can recognize that there is an obstacle ahead of the vehicle by switching the screen from the normal display state to the highlighted state It has become.

  The vehicle display device of the present invention is not only applied to the vehicle meter unit as in the above embodiment, but also a night vision display device (night vision image display device) mainly for night vision image display, The present invention can also be applied to a navigation device having a night vision image display function. As a result, even in these display devices, when an obstacle is identified, the image area including the obstacle can be enlarged and displayed on the night vision image display unit, and the driver can recognize the obstacle. It becomes easy. Further, in the vehicle display device of the present invention, the display content of the display area concealed by the enlarged night vision image area is not limited to the meter image in the meter image area, as the night vision image area is enlarged, Any predetermined display content other than the night vision photographed image may be used. For example, if the vehicular display device of the present invention is a display device of a navigation device, the meter image to be concealed can be a navigation screen image displayed in the navigation screen display area of the display unit of the navigation device.

The block diagram which shows an example of an electric constitution of the meter unit for vehicles of this invention The figure explaining the normal display state and highlight display state in a 1st Example of the meter unit for vehicles of this invention. The flowchart which shows the flow of a display panel drawing program. The figure explaining the emphasis display state in the 2nd example of the meter unit for vehicles of the present invention. The figure explaining the highlight state in the 3rd example of the meter unit for vehicles of the present invention. The figure explaining the emphasis display state in the 4th example of the meter unit for vehicles of the present invention. The figure explaining the highlight state in the 5th example of the meter unit for vehicles of the present invention. The figure explaining the highlight state in the 6th example of the meter unit for vehicles of the present invention.

Explanation of symbols

1 Vehicle meter unit 10 Meter ECU
11 CPU
12 RAM
13 ROM
13a Obstacle identification program 13b Display panel drawing program 17 External memory 30 Night vision camera 90 Drawing LSI
DESCRIPTION OF SYMBOLS 100 Drawing panel 101,101a, 101b, 101c Vehicle speed meter display area 102 Engine speed meter display area 103,103a Gasoline (fuel) remaining amount meter display area 104 Water temperature meter display area 110 Meter display part 120 Night vision image display part 121 Night vision image area 122 Obstacle marking display 123 Strip marking display 200 Body ECU
201 Vehicle speed sensor 202 Engine speed sensor 203 Fuel level sensor 204 Water temperature sensor

Claims (12)

A vehicle display device comprising display means capable of displaying a night vision image in front of the vehicle,
Obstacle identifying means for identifying an obstacle existing in front of the vehicle in the night vision image, and a night vision image area for displaying the night vision image on the display means when the obstacle is identified In the enlarged night vision image area, the night vision image displayed before identification of the obstacle is expanded in a wider visual field range around the obstacle. And a display control means for displaying the image in an enlarged form . The vehicular display device according to claim 1 , wherein the night vision image area is enlarged so that an aspect ratio is the same as that before enlargement while fixing a display field of view of the night vision image .   The vehicle display device according to claim 1, wherein the night vision photographed image region is set in a form of being superimposed on a background image region where a background image is displayed on the display unit. The vehicular display device according to claim 1, wherein the night vision photographed image area is integrally displayed together with a meter image area on a common screen of the display unit. The display control means displays a plurality of the meter image areas in the background of the night vision image area on the display means , and the night vision image area enlarged as the night vision image area is enlarged. The vehicular display device according to claim 4, wherein the captured image area is displayed in an overlapping manner so as to hide a part of the meter image area. The vehicle display according to claim 5 , wherein the meter image area maintains a display size and a display position of a portion that is not concealed by the enlarged night vision photographed image area before being enlarged. apparatus.   The meter image area includes a vehicle speed meter image area, and a part of the vehicle speed meter image area is concealed with the enlargement of the night vision photographed image area, and the night vision photograph after the enlargement of the vehicle speed meter image area The vehicle display device according to claim 5 or 6, wherein the vehicle speed instruction value is visible in a portion that is not concealed in the image area.   The meter image area includes a vehicle speed meter image area and an engine speed meter image area, and the night vision image area has a hidden area of the engine speed meter image area larger than the vehicle speed meter image area. The vehicular display device according to any one of claims 5 to 7, which is enlarged as described above. The display control means displays a plurality of meter image areas in the background of the night vision image area on the display means , and the display mode of at least a part of the plurality of meters is a standard display mode. And a multi-mode meter having a reduced display mode that is smaller than the standard display mode and that corresponds to the enlargement of the night vision photographed image area. Along, vehicle display device according to any one of the multimode meter image display the standard billing from the display mode that is displayed is switched to the reduced display mode to claim 4 through claim 8.   The vehicle display device according to claim 9, wherein the multi-mode meter includes at least one of a speed meter and a fuel meter. The vehicle display device according to claim 9 or 10, wherein the meter image area in the reduced display mode is displayed on a background outside the enlarged night vision photographed image area.   The vehicle display device according to any one of claims 9 to 11, wherein the meter image area in the reduced display mode is displayed in an overlapping manner within the enlarged night vision photographed image area.