JP2007087337A - Vehicle peripheral information display device - Google Patents

Vehicle peripheral information display device Download PDF

Info

Publication number
JP2007087337A
JP2007087337A JP2005278551A JP2005278551A JP2007087337A JP 2007087337 A JP2007087337 A JP 2007087337A JP 2005278551 A JP2005278551 A JP 2005278551A JP 2005278551 A JP2005278551 A JP 2005278551A JP 2007087337 A JP2007087337 A JP 2007087337A
Authority
JP
Japan
Prior art keywords
notification
notification target
driver
information
means
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2005278551A
Other languages
Japanese (ja)
Inventor
Shinya Kawamata
進也 川真田
Original Assignee
Toyota Motor Corp
トヨタ自動車株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toyota Motor Corp, トヨタ自動車株式会社 filed Critical Toyota Motor Corp
Priority to JP2005278551A priority Critical patent/JP2007087337A/en
Publication of JP2007087337A publication Critical patent/JP2007087337A/en
Application status is Pending legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Arrangement of adaptations of instruments
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2370/00Details of arrangements or adaptations of instruments specially adapted for vehicles, not covered by groups B60K35/00, B60K37/00
    • B60K2370/10Input devices or features thereof
    • B60K2370/12Input devices or input features
    • B60K2370/149Input by detecting viewing direction
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2370/00Details of arrangements or adaptations of instruments specially adapted for vehicles, not covered by groups B60K35/00, B60K37/00
    • B60K2370/18Information management
    • B60K2370/191Highlight information

Abstract

<P>PROBLEM TO BE SOLVED: To clarify what a driver should be most notified of among a plurality of detected notification objects. <P>SOLUTION: A vehicle peripheral information display device is provided with a vehicle peripheral information acquiring means (visible image pickup means 10A, infrared image pickup means 10B) for acquiring vehicle peripheral information, a notification object detecting means 31 for detecting notification objects 71 and 72 to a driver in the periphery of a vehicle based on vehicle peripheral information from the vehicle peripheral information acquiring means (visible image pickup means 10A, infrared image pickup means 10B), a display means 40 for displaying the information of the detected notification objects 71 and 72, a notification significance setting means 32 for deciding the notification significance of the plurality of detected notification objects 71 and 72 and an announcement information generating means 33 for generating announcement information(notification object frames 81 and 82) to the driver relating to the notification objects 71 and 72. The announcement information generating means 33 generates announcement information(notification object frame 82) which easily stimulates the five senses of the driver for the notification object 72 whose notification significance is high as compared with the notification object 71 whose notification significance is low. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a vehicle surrounding information display device that informs the driver of the presence of a notification target for a driver such as an object or a human being present around the vehicle.

  The vehicle may be used in an environment with good visibility such as daytime, or may be used in an environment with poor visibility such as at night or in bad weather. For this reason, the driver can recognize objects such as falling objects and people around the vehicle with his / her eyes from the actual scene in an environment with good visibility. Then, it is difficult to see all of these from the actual scene. For this reason, conventionally, a vehicle surrounding information display device has been developed that informs the driver of the presence of an object to be notified to the driver, such as an object or a person existing around the vehicle.

  For example, as this type of vehicle surrounding information display device, there is a so-called head-up display (HUD) that displays a scenery in front of the vehicle as a notification image as a virtual image on a front windshield, which is disclosed in Patent Document 1 below.

  The vehicle surroundings information display device (head-up display device) disclosed in Patent Document 1 displays information (★) with a strong visual stimulus to the driver when a notification target in front of the vehicle is detected. Information (Δ) for guiding the driver's line of sight from the place is moved toward the notification target on the head-up display. That is, in the vehicle surrounding information display device disclosed in Patent Document 1, information with high characteristics (in other words, attractiveness) that stimulates the driver's vision and guides the line of sight after detection of the notification target is displayed. The driver is informed of the presence of the notification target.

  Further, similar vehicle surrounding information display devices (head-up display devices) for displaying such highly attractive information are also disclosed in Patent Documents 2 to 4 below.

  First, the vehicle surrounding information display device disclosed in Patent Document 2 displays highly attractive information when the driver is not looking at the display on the head-up display, while viewing the display on the head-up display. Displays information with low attraction.

  In addition, the vehicle surrounding information display devices disclosed in Patent Documents 3 and 4 suppress the provision of information on the respective notification targets detected as necessary. Specifically, the vehicle surrounding information display device of Patent Document 3 suppresses the provision of information to a notification target having high visibility and attractiveness, and provides the driver with information related to the minimum notification target. This prevents information more than necessary from being given and reduces the driver's annoyance. On the other hand, the vehicle surrounding information display device of Patent Document 4 provides the driver with more information than necessary by suppressing the provision of the information to be notified that exists near the driver's gazing point. This reduces the annoyance of the driver.

  Patent Document 5 listed below discloses an obstacle detection device configured to make it easier to issue an alarm when the detected notification target is poor in visibility than when it is good.

JP 2003-291688 A JP-A-7-61257 JP 2004-30212 A JP 2001-357498 A JP 2000-251200 A

  However, any of the vehicle surrounding information display devices disclosed above only touches on the technology when a single notification target is detected, and the situation in a general vehicle usage environment, that is, a plurality of notification targets. It is not taken into consideration when the is detected.

  For this reason, assuming that the conventional vehicle surrounding information display device described above is applied when a plurality of notification targets are detected, in the vehicle surrounding information display device, which notification target should be most carefully noted. It is not easy to discriminate from the display of the head-up display. In addition, if the attractiveness of each notification target is changed in the vehicle surrounding information display device, attention is directed only to the notification target set with high attraction, and attention to other notification targets is neglected. There is a risk that. And by such a thing, the information object which a driver should pay attention to cannot be recognized, or the recognition is delayed. There is a possibility of reducing safety.

  Therefore, the present invention improves the inconvenience of the conventional example, clearly indicates what should be informed to the driver among a plurality of detected notification objects, and further notifies that the driver does not recognize. It is an object of the present invention to provide a vehicle surrounding information display device that can recognize the presence of a target.

  In order to achieve the above object, according to the first aspect of the present invention, vehicle surrounding information acquisition means for acquiring information around the vehicle, and notification to the driver around the vehicle based on the vehicle surrounding information from the vehicle surrounding information acquisition means. In a vehicle surrounding information display device comprising a notification target detection means for detecting a target and a display means for displaying information on a notification target detected by the notification target detection means, a plurality of information detected by the notification target detection means The notification importance setting means for determining the notification importance level of the notification target and the notification information generation means for generating notification information to the driver related to the notification target are provided, and the notification information generation means has the notification importance level. It is configured to generate notification information that is easier to stimulate the driver's senses than a notification target with a low notification importance for a high notification target.

  According to the vehicle surrounding information display device according to claim 1, among all detected notification objects, the one having the highest notification importance, that is, the one that should be most informed to the driver is clearly transmitted to the driver. Indicated. For this reason, the driver can recognize which notification target should be driven most carefully among all detected notification targets.

  In order to achieve the above object, in the invention described in claim 2, in the vehicle surrounding information display device described in claim 1, the level of notification importance is set stepwise for each detected notification target. The notification importance setting means is configured to do so.

  According to the vehicle surrounding information display device according to the second aspect, since the respective notification targets are ranked according to the notification importance, the priority order to be notified to the driver from among the notification targets becomes clear. . For this reason, by generating notification information based on such notification importance, the driver can more easily recognize which notification target should be driven most carefully among all detected notification targets. Will be able to.

  In order to achieve the above object, according to a third aspect of the present invention, in the vehicle surrounding information display device according to the first or second aspect, whether or not the driver has recognized the notification target displayed on the display means. A notification target recognition presence / absence determination unit is provided for determining and notifying the notification target determined to be recognized from the determination target of the notification importance setting unit.

  According to the vehicle surrounding information display device according to the third aspect, the notification importance level is determined for the notification target that the driver does not recognize, and the notification target having the highest notification importance level is selected next. It can be clearly shown as an important thing to be informed about. For this reason, the driver can grasp what should be driven most carefully among the unrecognized notification targets.

  Here, as in the invention according to claim 4, in the vehicle surrounding information display device according to claim 3, the notification target determined to be recognized by the notification target recognition presence / absence determining means is determined to be unrecognized. The notification information generating means is configured to generate notification information that is less likely to stimulate the five senses than the notification target. As a result, the unrecognized notification target becomes clearer than the recognized one. For example, when there is only one remaining unrecognized notification target, this is the only thing that should be made most known to the driver. Clearly shown. For this reason, the driver can drive while paying attention to the remaining one unrecognized notification target.

  In order to achieve the above object, in the invention described in claim 5, in the vehicle surrounding information display device described in claim 1 or 2, whether or not the driver has recognized the notification target displayed on the display means. A notification target recognition presence / absence determination unit is provided for generating notification information that is less likely to stimulate the senses than a notification target determined to be unrecognized for a notification target determined to be recognized by the notification target recognition presence / absence determination unit. The notification information generating means is configured.

  According to the vehicle surrounding information display device of the fifth aspect, even if the driver once recognizes the notification target that has been detected for a long time, it can be notified again. For this reason, for example, the driver is relieved by paying attention to the notification target recognized by the driver, and even if the attention to the presence is distracted by being informed about other notification targets, It is possible to drive while paying attention to the notification target again by notification.

  Here, as the notification information generated by the notification information generation means, for example, information displayed on the display means and appealing to the driver's vision can be used as in the invention described in claim 6.

  Further, as the notification information generated by the notification information generation means for the notification target having a high notification importance, for example, as shown in the seventh aspect of the invention, the display means has higher luminance than the notification target having a low notification importance. Those that are lit up or blinked on the display means can be used.

  The vehicle surrounding information display device according to the present invention can clearly indicate to the driver what to be most careful of when detecting a plurality of notification targets, and is not yet recognized by the driver. Since the driver can be made aware of the above, it is possible to prevent the driver from recognizing or delaying recognition of the notification target, and to improve the safety that is the original purpose of the present apparatus.

  Embodiments of a vehicle surrounding information display device according to the present invention will be described below in detail with reference to the drawings. The present invention is not limited to the embodiments.

  A vehicle surrounding information display device according to a first embodiment of the present invention will be described with reference to FIGS.

  Initially, the structure of the vehicle surroundings information display apparatus in the present Example 1 is demonstrated using FIG.

  The vehicle surrounding information display device according to the first embodiment is obtained by a vehicle surrounding information acquisition unit that acquires vehicle surrounding information, a line-of-sight detection unit 20 that detects movement of a driver's line of sight, and the vehicle surrounding information acquisition unit. A control means (ECU) 30 for receiving vehicle surrounding information and driver's line-of-sight information detected by the line-of-sight detection means 20 and executing the following various calculation processes based on the vehicle surrounding information and the driver's line-of-sight information; And a display means 40 for displaying the calculation processing result of the control means 30.

  In the control means 30 of the vehicle surrounding information display apparatus in the first embodiment, as its calculation processing function, as shown in FIG. 1, from the vehicle surrounding information acquisition means (here, visible imaging means 10A and infrared imaging means 10B). Based on the received vehicle surrounding information, notification target detection means 31 for detecting a notification target to a driver such as an object or a person around the vehicle, and a driver about the notification target detected by the notification target detection means 31 Notification importance level setting means 32 for setting the importance level to be notified (hereinafter referred to as “notification importance level”) and information for notifying the driver of the presence of the detected notification target (hereinafter referred to as “notification”). Notification information generating means 33 for generating information, display processing means 34 for displaying information to be notified on the display means 40, and driving from the line-of-sight detection means 20. And determining the line of sight determining unit 35 whether or not viewing the broadcast object on the driver's display unit 40 is provided on the basis of the viewing information. Here, in the first embodiment, the notification information generated by the notification information generation means 33 is exemplified by information visually appealing as will be described later. This display information is also displayed on the display means 40 by the display processing means 34. Is displayed.

  Hereinafter, a specific example of the vehicle surrounding information display device according to the first embodiment will be described in detail. For example, here, an imaging means such as a visible camera or an infrared camera that images the surroundings of the vehicle is used as the vehicle surrounding information acquisition means, and the vehicle surrounding information display that notifies the driver of the notification target of the surroundings of the vehicle based on the captured image The apparatus will be exemplified. More specifically, as the vehicle surrounding information acquisition means, an imaging means provided in the front part of the vehicle (in the vicinity of the rear-view mirror in the vehicle interior, a bumper opening, etc.) is used. An example of a vehicle surrounding information display device that alerts the driver of an object to be notified, such as an object in front of the vehicle or a human being when driving in bad weather, or the like will be illustrated. In this vehicle surrounding information display device, as shown in FIG. 1, two types of imaging means, a visible imaging means (visible camera) 10A and an infrared imaging means (infrared camera) 10B, are used as vehicle surrounding information acquisition means. It arrange | positions to a position and the alerting | reporting importance of alerting | reporting object is determined as mentioned later using the two captured images.

  The notification target detection means 31 of the control means 30 in such a vehicle surrounding information display device is provided to the driver in front of the vehicle based on each video signal of, for example, the NTSC system received from the visible imaging means 10A and the infrared imaging means 10B. All notification target detection processes are performed. Such a notification target can be detected by a method well known in the art.

  For example, the notification target detection unit 31 performs image processing on the captured image from the visible imaging unit 10A to detect an object, a person, or the like, and determines whether this can be a notification target. In this case, the notification target detection means 31 may be configured to detect all of them as notification targets if they are humans such as pedestrians, and if the object is an object such as a building or an obstacle, The positional relationship and the road shape in front of the vehicle may be determined in combination, and if this object exists on the traveling road of the host vehicle, this may be detected as a notification target.

  In addition, since this vehicle surrounding information display device is equipped with the infrared imaging means 10B, the notification target detection means 31 detects a human or animal that is a notification target from the information of the heat source distribution received from the infrared imaging means 10B. can do.

  Here, as an object existing on the traveling path of the own vehicle, there are falling objects, other vehicles that are stopped, and other vehicles that are traveling in front of the own vehicle. For this reason, the notification target detection means 31 includes the vehicle speed information of the vehicle speed sensor 51 that is sequentially detected and the change information of the position of the object from the respective video signals of the visible imaging means 10A and the infrared imaging means 10B that are sequentially received. Based on the above, the relative speed between the vehicle and the object is calculated, and the relative speed and the vehicle speed are compared to determine whether or not the object is a notification target. Obviously, falling objects on the road of the vehicle and other vehicles that are stopped can be subject to notification, but other vehicles that are traveling in front will be notified by their relative speed. There are cases where it is a target and cases where it is not a notification target.

  By the way, this notification target detection means 31 takes into account the distance information between a person or an object that can be a notification target in the captured image and the own vehicle and the vehicle speed information acquired from the vehicle speed sensor 51, and calculates the distance and the vehicle speed. If the relationship is within a predetermined range, a person or an object that can be a notification target may be detected as the notification target. For example, the notification target detection unit 31 does not set a notification target if the distance to a person or an object that can be a notification target with respect to the current vehicle speed is longer than a predetermined distance, and the distance to the current vehicle speed is a predetermined distance. You may comprise so that it may become alerting | reporting object, if it is within.

  Next, the notification importance setting means 32 in the control means 30 of this vehicle surrounding information display device will be described in detail.

  Here, the notification target detection unit 31 described above may detect a plurality of notification targets at the same time from the respective video signals of the visible imaging unit 10A and the infrared imaging unit 10B captured at the same time. Each of them is detected as a notification target because it is determined that the driver should be informed, and it is certain that it is necessary to notify the driver of all the existences.

  However, among such a plurality of notification targets, there are some that need to immediately notify the driver of the presence, and others that do not, and all the notification targets have the same level of notification importance. It is not preferable to treat it as a thing. For example, it is highly important to inform the driver about humans crossing the road of the vehicle and falling objects on the road of the vehicle, but compared to this, the pedestrian traffic zone For pedestrians, etc., there is little need to notify immediately and the importance of notification is low. Further, for example, when there are a plurality of notification objects on the traveling road of the own vehicle, the notification object having a short distance from the own vehicle should be preferentially notified even when the notification importance is high.

  Therefore, in the first embodiment, notification importance setting means 32 for setting the notification importance for each of the plurality of notification objects detected by the notification object detection means 31 is provided. The notification importance here refers to the priority of the notification target to be notified to the driver. For example, the notification importance level setting unit 32 according to the first embodiment is configured to set different levels of notification importance levels stepwise for each detected notification target based on the priority. That is, the notification importance setting means 32 of the first embodiment is an arithmetic processing function that specifies the priority order of items to be preferentially notified to the driver from among a plurality of detected notification targets. I can say that.

  Specifically, various criteria can be set according to the vehicle, the usage environment, and the like as the determination criteria when the notification importance setting unit 32 sets the notification importance.

  For example, if a plurality of detected objects include a person who crosses the traveling road of the own vehicle and a pedestrian in a pedestrian zone, the person who crosses the traveling road of the own vehicle is a pedestrian. Since it is more necessary to inform the driver than pedestrians in the traffic zone, the notification importance level is set to “1”, and for the pedestrians in the pedestrian traffic zone, the notification importance level is set to “2”. . Here, the smaller the set number is, the higher the notification importance is.

  Some of the notification targets detected may be recognized by the driver with his / her eyes from the actual scene, while others may not be recognized with his / her eyes in an environment with poor visibility such as at night. For this reason, it may be preferable to inform the driver about such a notification object that cannot be visually observed rather than what can be visually observed. Therefore, in the first embodiment, it is determined that the notification importance degree is higher than that which can be visually observed for the notification target that cannot be visually recognized among the plurality of detected notification targets.

  By the way, in order to make such a determination, it is necessary to determine whether the detected notification object is visible to the driver or not. Here, in the vehicle of the first embodiment, two types of imaging means, that is, a visible imaging means 10A and an infrared imaging means 10B are mounted, and the visible imaging means 10A is a real scene that the driver sees with his / her own eyes. The infrared imaging means 10B can also capture an object or person that the driver cannot recognize with confidence in an environment with poor visibility such as at night. For this reason, the notification importance setting unit 32 of the first embodiment compares the notification targets detected from the video signals of the visible imaging unit 10A and the infrared imaging unit 10B, and the notification targets that match each other are compared. It is determined that the driver can visually recognize, and on the other hand (specifically, the infrared imaging means 10B), the notification target that is detected only by the driver is determined to be invisible to the driver.

  Here, it is also possible to assume a case where, among the detected notification targets, a notification target that cannot be visually observed and a notification target such as a human who crosses the traveling path of the host vehicle are mixed. In such a case, both of them have high notification importance, but it is preferable to give superiority to inferiority to these. For this reason, in such a case, for example, the distance between the vehicle and the own vehicle is calculated, and it is determined that the notification importance is high for the notification target having the shorter distance. In addition, it is conceivable that the distances are substantially the same, and in this case, a notification target that cannot be visually observed is determined to have a higher notification importance.

  Further, the notification importance level setting means 32 may be configured to determine the notification importance level according to the detected type of notification target. For example, if there is a high need to inform the driver such as a person crossing the road of his / her own vehicle, the notification importance level is set to “1”, and the driver such as a pedestrian in a pedestrian traffic zone is set. It is determined in advance that the information needing to be informed is set to the notification importance “2”. In such a case, when a plurality of notification targets having the same notification importance level “1” are detected, the notification importance level setting unit 32 further considers the distance from the above-described vehicle, visibility, and the like. It is configured so that the level of notification importance is gradually increased. For example, among the notification targets of the notification importance level “1”, the notification target level “1a” is set as the notification importance level “1a”, and the notification importance level “1” is set farther from the own vehicle. 1b ". Here, it is assumed that the notification importance is decreased in the order of notification importance “1a”, “1b”, “1c”,.

  Next, the notification information generating means 33 in the control means 30 of this vehicle surrounding information display device will be described in detail. The notification information generation means 33 is configured to generate notification information that informs the driver of the presence of the detected notification target.

  The notification information is generally information that can stimulate the driver's five senses, and the vehicle surrounding information display device according to the first embodiment also generates notification information that can generate such notification information that can stimulate the five senses. The generation means 33 is configured.

  Specifically, the notification information generating unit 33 according to the first embodiment generates visually appealing information as the notification information, and displays the information together with the captured images of the visible imaging unit 10A and the infrared imaging unit 10B including the video to be notified. An example is shown in which the processing means 34 is configured to display on the combiner 42 of the display means 40 described later. More specifically, in the first embodiment, the notification information generating means 33 generates a frame surrounding the detected notification target (hereinafter referred to as “notification target frame”), and the notification target frame is displayed. The means 34 is configured to be displayed on the combiner 42 as notification information. Thereby, since the notification target frame stimulates the driver's vision, the driver's line of sight can be guided to the corresponding notification target. In other words, the notification target frame is used as notification information having a characteristic (in other words, attractiveness) that stimulates the driver's vision to guide the line of sight.

  Here, when the notification information (notification target frame) is displayed on the combiner 42 for all the notification targets detected simultaneously, the image of the combiner 42 becomes complicated depending on the quantity of the notification target. The person not only feels annoyed, but also makes it difficult to determine which of the notification targets in the image of the combiner 42 should be noted most. For this reason, in the worst case, the notification target that the driver must be careful of cannot be recognized or the recognition may be delayed, which may reduce the safety.

  On the other hand, if the notification information is not displayed for a part of the notification target because the image of the combiner 42 becomes complicated, there is only the visual information obtained from the actual scene for the notification target of the non-display target. Thus, there is a possibility that the non-display target notification target may be missed or recognition of the notification target may be delayed, and the vehicle surrounding information display device in the first embodiment that informs the driver of the presence of the notification target in front of the vehicle It is not preferable for the original purpose.

  Therefore, the notification information generating unit 33 according to the first embodiment generates notification information that is easier to stimulate the driver's five senses for a notification target having a high notification importance than for a notification target having a low notification importance. Constitute. Specifically, the notification information generation unit 33 of the first embodiment is conspicuous as the notification information with respect to the notification target having the high notification importance is more likely to guide the driver's line of sight than the notification target having the low notification importance. Announcement information is generated (that is, a high degree of attractiveness). For example, in the first embodiment, the above-described notification target frame is used as the notification information generated for each notification target, and for the notification target having a high notification importance, the luminance of the notification target frame. Is set higher than a notification target having a low notification importance. Accordingly, the notification target frame related to the notification target having the high notification importance is highlighted with respect to the notification target frame related to the notification target having the low notification importance, so that the driver can display the high-luminance notification target frame ( That is, the line of sight is taken away with respect to the highlighting frame), and the notification target to be most careful can be recognized first.

  Here, in the notification information generation means 33 of the first embodiment, it is assumed that the brightness of the notification target frame to be generated is preset for each notification importance level. For example, when it is assumed that the color of the notification target frame generated for each notification target is the same, the luminance level “1” is set for the notification importance “1” among the notification targets. The notification target frame with the luminance level “2” is generated for the notification importance level “2”. Here, it is assumed that the notification target frame with higher luminance is generated as the luminance level number is smaller.

  In addition, the notification information generating unit 33, when it is determined that the notification target displayed on the combiner 42 is recognized by the line-of-sight determination unit (notification target recognition presence / absence determination unit) 35 described later, Is configured to generate notification information that is less likely to stimulate the five senses than an unrecognized notification target. For example, the notification information generation unit 33 of the first embodiment makes the luminance of the notification target frame related to the recognized notification target lower than the luminance of the notification target frame related to the unrecognized notification target.

  By the way, considering the notice information from the viewpoint of emphasis display, there is differentiation by such brightness, and differentiation by blinking display and lighting display. For this reason, the notification information generating unit 33 according to the first embodiment may be configured to generate notification information (notification target frame) that can be blinked and displayed by the display processing unit 34 for a notification target having a high notification importance. Good. In such a case, the notification target frames related to all notification targets may be set to a constant luminance regardless of the notification importance level, and differentiation by luminance similar to the above may be used in combination.

  Furthermore, the notification information generating means 33 of the first embodiment has less visual stimulation than the notification target for which highlighting is performed for items other than the notification target for which such highlighting is performed (that is, You may change a brightness | luminance within the range (attractiveness is low). For example, you may make it make a difference in the brightness | luminance of a notification object frame between people, animals, etc. and objects, such as another vehicle and a building. Moreover, you may make it make a difference in the brightness | luminance of a notification object frame between moving bodies, such as a person and the other vehicle currently drive | running, and non-moving bodies, such as a building.

  Here, even though the notification importance level setting unit 32 of the first embodiment sets the level of the notification importance level so as to prioritize the plurality of notification targets, the driver is notified about the notification target with a low notification importance level. You don't have to tell them. In addition, it is preferable to inform the driver of a notification target with the next highest importance of notification, rather than highlighting or continuing to highlight the notification target once recognized by the driver from the image of the combiner 42. For this reason, in the vehicle surrounding information display device according to the first embodiment, the presence of the information is preferentially notified to the driver in order from the notification target having the highest notification importance.

  Therefore, in the first embodiment, it is determined whether the driver recognizes the notification target displayed on the combiner 42, and the notification target determined to be recognized is determined by the notification importance setting means 32 ( Hereinafter, a notification target recognition presence / absence determination unit excluded from “importance determination target”) is provided. Specifically, the visual line determination means 35 described above is provided as the notification target recognition presence / absence determination means of the first embodiment. As described above, the line-of-sight determination unit 35 determines whether or not the driver has visually recognized the notification target displayed on the combiner 42, and the determination of the driver acquired by the line-of-sight detection unit 20 is performed. It is configured to perform based on line-of-sight information.

  Here, in the first embodiment, as will be described later, the head-up display device is used as the display means 40. Therefore, as shown in FIG. 2, the display 41a constituting the display means 40 is used. In the vicinity, an imaging means such as a visible camera with a lens facing as if the combiner 42 is imaged is arranged as the line-of-sight detection means 20 of the first embodiment.

  That is, in the display means 40, the image of the display device 41 a is projected onto the combiner 42, and the image is displayed on the driver's eyes as a virtual image formed by the combiner 42. On the other hand, when viewed from the display 41a side, the driver's eyeball can be seen through the combiner 42 in the vicinity of the display 41a. Therefore, if the line-of-sight detection means 20 as an image pickup means is arranged in the vicinity of the display device 41a as if the combiner 42 was imaged, the movement of the driver's eyeball can be detected by the line-of-sight detection means 20, so this embodiment In Example 1, an imaging unit is used as the line-of-sight detection unit 20 and is arranged in such a manner. In FIG. 2, the projection angle of the image from the display device 41a and the imaging angle of the line-of-sight detection means 20 are greatly deviated. Are arranged so as to be substantially equal.

  The video signal of the driver's eye image captured by such a line-of-sight detection unit 20 is sent to the line-of-sight determination unit 35 of the first embodiment, and whether or not the driver has visually recognized the notification target displayed on the combiner 42. It is used for judgment. For example, the line-of-sight determination means 35 compares the display section of each notification target on the image of the combiner 42 with the black eye display section of the driver's eyeball on the combiner 42 and displays the same display as the black eye display section. The notification target on the section is determined as having been visually recognized by the driver.

  Next, the display means 40 in this vehicle surrounding information display device will be described in detail.

  In the first embodiment, a so-called head-up display device that projects an image onto a front windshield is used as the display means 40.

  The display means (head-up display device) 40 according to the first embodiment has a configuration well known in the technical field. For example, as shown in FIG. 2, the visible imaging means 10A and the infrared imaging means 10B described above are used. A head-up display unit (hereinafter referred to as “HUD unit”) 41 to which a video signal is input, and a combiner 42 on which an image projected from the HUD unit 41 is formed.

  The HUD unit 41 includes a display 41a for displaying a captured image related to a video signal received from the visible image capturing unit 10A and the infrared image capturing unit 10B and notification information generated by the notification information generating unit 33 of the control unit 30; A light source 41b for projecting the display content displayed on the display 41a to the combiner 42, and an instrument panel 62 extending from the lower edge side of the front windshield 61 shown in FIG. Will be deployed.

  In this HUD unit 41, light from a light source 41b functioning as a backlight is incident from the back of a display 41a made of, for example, a liquid crystal panel, and emitted light related to the display content of the display 41a is distributed to the front windshield 61. It is projected onto the installed combiner 42.

  Here, the combiner 42 is composed of a functional member whose reflection angle varies depending on the wavelength, such as a holographic optical element, and directs the wavelength component related to the display content of the emitted light to the driver's eyes. Is set to reflect. For this reason, the emitted light related to the display content is imaged in front of the driver, whereby the display content of the display 41a, that is, the virtual image corresponding to the captured image and notification information of the visible imaging means 10A and the infrared imaging means 10B. Is displayed in front of the driver.

  Hereinafter, the operation of the vehicle surroundings information display apparatus according to the first embodiment will be described with reference to the actual scenes shown in FIGS. 4 to 7 and the image of the display means 40 based on the flowchart of FIG.

  In the vehicle surrounding information display device of the first embodiment, the video signals of the visible imaging means 10A and the infrared imaging means 10B are transmitted to the control means 30 and the display means 40, and the control means 30 receives the video signals. Assume that an image related to the video signal is displayed on the combiner 42 of the display means 40 each time.

  First, when receiving the video signal from the visible imaging unit 10A and the infrared imaging unit 10B (step ST1), the control unit 30 according to the first embodiment is notified by the notification target detection unit 31 based on each video signal. Whether or not there is is determined (step ST2).

  Here, this control means 30 will return to step ST1, if the alerting | reporting object is not detected.

  On the other hand, when the image related to the video signal is as shown in FIG. 4 and the notification target detection means 31 determines that there are notification targets (persons) 71 and 72, the control means 30 sets the notification importance setting means. 32, it is determined whether or not the detected notification objects 71 and 72 are importance determination processing objects (step ST3). The importance level determination processing target here is a notification target for which the notification importance level determination process is performed by the notification importance level setting unit 32. In other words, a notification target frame highlighting described later is executed. Point to what to do.

  For example, since the respective notification targets 71 and 72 are detected for the first time here, in this step ST3, it is determined that each notification target 71 and 72 is an importance determination processing target, and the process proceeds to step ST4. .

  Then, the notification importance level setting unit 32 sets the notification importance levels of the two detected notification targets 71 and 72 (step ST4).

  For example, one notification object 71 detected in the first embodiment is a pedestrian who is walking in a pedestrian traffic zone, and the other notification object 72 detected at the same time crosses the traveling road of the own vehicle. A person who is trying to cut. Here, the person (notification object 72) who is going to cross the traveling path of the own vehicle shown in FIG. 4 is farther from the own vehicle than the pedestrian walking in the pedestrian zone (notification object 71). Exists. For this reason, in the normal determination process, it is determined that the notification target 71 is higher in notification importance than the notification target 72 in view of the positional relationship with the host vehicle. However, when comparing the notification targets 71 and 72 from a general point of view, the driver (notification target 72) who is about to cross the traveling road of the vehicle should be informed to the driver with priority. It is. Therefore, in the case of the respective notification targets 71 and 72 as exemplified here, the notification importance setting means 32 determines that the notification target 72 has a higher notification importance than the notification target 71. For this reason, the notification importance level setting unit 32 sets the notification importance levels “2” and “1” for the notification targets 71 and 72, respectively.

  After the notification importance is thus determined and the notification importance is set for each of the notification objects 71 and 72, the control means 30 of the first embodiment generates the notification information as shown in FIG. The high-intensity notification target frame (highlighted display frame) 82 surrounding the notification target 72 with high notification importance is generated by the means 33, and this notification target frame 82 is displayed on the combiner 42 of the display means 40 by the display processing means 34. (Step ST5). Thereafter, the control unit 30 causes the notification information generation unit 33 to generate a notification target frame 81 having a low luminance (lower luminance than the notification target frame 82) surrounding the remaining notification target 71, and this notification target frame 81 is displayed. The display processing means 34 displays on the combiner 42 (step ST6). At that time, the respective notification target frames 81 and 82 may be generated and displayed at the same time.

  This makes it easier for the driver to guide the line of sight to the high-intensity notification target frame 82 regardless of whether the driver is gazing at the actual scene in front of the eyes or the image of the combiner 42. It is possible to drive while paying close attention to the notification target 72 related to the notification target frame 82 to be poured.

  Subsequently, the control unit 30 according to the first embodiment uses the line-of-sight determination unit 35 to determine whether or not the driver visually recognizes the notification targets 71 and 72 of the combiner 42 based on the driver's line-of-sight information from the line-of-sight detection unit 20. (Step ST7).

  Usually, since the driver first visually recognizes the notification target 72 related to the highlighted notification target frame 82, it is determined here that the line-of-sight determination means 35 has visually recognized the notification target 72, and the notification target 72 is displayed. Exclude from the importance determination process target (step ST8). And the control means 30 makes the brightness | luminance of the alerting | reporting object frame 82 which concerns on the alerting | reporting object 72 low as shown in FIG. 6 (step ST9), and returns to said step ST1.

  For example, in step ST9, the brightness of the notification target frame 82 related to the notification target 72 may be the same as that of the notification target frame 81 related to the other notification target 71. As shown in FIG. 6, the lowest-luminance notification target frame 82a surrounding the notification target 72 so that the target frame 82 has a lower luminance than the notification target frame 81 (for example, the lowest luminance among all notification targets). Is generated by the notification information generating means 33. As a result, the notification target frame 81 related to the other notification target 71 is inevitably highlighted with respect to the notification target frame 82a, so that the other notification target 71 is not subjected to further calculation processing. The driver's line of sight is easily guided.

  On the other hand, whether or not to shift the line of sight to the image of the combiner 42 depends on the driver's intention. This is the same even if the notification target frame 82 is highlighted in step ST5. For this reason, the driver may not see the image of the combiner 42. In such a case, it is determined in step ST7 that the respective notification objects 71 and 72 are not visually recognized, and the current image (FIG. 5). While maintaining the above, the process returns to step ST1.

  Next, the control means 30 that has returned to step ST1 through step ST9 receives a new video signal and repeats the same calculation process. Here, it is assumed that the same two notification targets 71 and 72 described above are detected, and that another notification target is not detected.

  In this case, since the notification target 72 is excluded from the importance determination processing target in the previous step ST8, only the notification target 71 is determined as the importance determination processing target in step ST3 here. The Here, since no other notification target is detected, it is determined in step ST4 that the notification target 71 has a high notification importance, and the high-brightness notification target frame 81a surrounding the notification target 71 is stepped. After being generated in ST5, it is displayed on the combiner 42 as shown in FIG.

  Here, after that, the calculation process of step ST6 may be performed on the notification target 72 initially highlighted, but the notification target frame 82a related to the notification target 72 is already low in luminance. The calculation process may be omitted.

  In addition, as illustrated here, only two notification objects 71 and 72 are detected, and when the driver visually recognizes the notification object 72 that is initially highlighted after highlighting one of the two, the above-described case is described. As described above, since the notification target frame 82a having the lowest luminance is displayed for the highlighted notification target 72, the other notification target 71 is automatically highlighted. For this reason, in such a case, the process may proceed to step ST7 without repeating the above-described calculation processes from step ST4 to ST6 for the other notification target 71.

  Subsequently, whether or not the notification target 71 on the combiner 42 has been visually recognized by the driver is determined in step ST7, and if it is visually recognized, this is excluded from the importance determination processing target in step ST8, and then after step ST9. As shown in FIG. 7, the notification target frame 81b having the lowest luminance is also displayed for the notification target 71. The brightness of the notification target frame 81b is the same as that of the notification target frame 82a related to the notification target 72 highlighted first, but it is not necessarily the same.

  Thereafter, the control unit 30 returns to step ST1 and repeats the same calculation process based on a new video signal. Here, when a new notification target is not detected from the video signal received in step ST1 and the two notification targets 71 and 72 described above are detected again, each of them is already excluded from the importance determination processing target. Therefore, it is determined in step ST3 that there is no importance determination process target, and the process proceeds to step ST6. Here, since the respective notification objects 71 and 72 are surrounded by the lowest luminance notification object frames 81b and 82a, the process may return to step ST1 without proceeding to step ST6.

  By the way, when the notification targets 71 and 72 are first detected and the low-brightness notification target frame 81 and the high-brightness notification target frame 82 are displayed for the notification targets 71 and 72, respectively, as shown in FIG. The driver does not necessarily visually recognize only the notification target 72 related to the high-luminance notification target frame 82, and may also visually recognize both of the two notification targets 71 and 72 at substantially the same time. For this reason, when each of the notification targets 71 and 72 is visually recognized substantially simultaneously, after the step ST7 determination by the line-of-sight determination means 35, each of the notification targets 71 and 72 is determined from the importance determination processing target in step ST8. The notification target frames 81 and 82 related to the notification targets 71 and 72 are set to the lowest luminance in step ST9. That is, in such a case, the notification target frames 81b and 82a shown in FIG. 7 are displayed on the combiner 42 without going through the state shown in FIG.

  As described above, the line-of-sight determination means 35 does not necessarily set only the highlighted notification target as the determination target, but sets all the notification targets displayed on the combiner 42 as the determination targets.

  As described above, in the vehicle surrounding information display device according to the first embodiment, the notification importance is set stepwise for each detected notification target, and the notification target having a high notification importance is notified to the notification target having a high notification importance. Since highlighting is performed in a notification target frame having a luminance higher than that of the target, the most noticeable notification target among the plurality of notification targets detected becomes clear. For this reason, by using the vehicle surroundings information display device of the first embodiment, the driver recognizes which notification target should be driven most carefully among all detected notification targets. To improve safety.

  Further, in this vehicle surrounding information display device, the brightness of the notification target frame (notification information) related to the notification target recognized by the driver is lowered so that it is not conspicuous with respect to the unrecognized one. Then, the notification importance is set in the same manner for the remaining unrecognized notification targets, and the notification target having the higher notification importance is highlighted in the notification target frame having higher brightness than the notification target having the lower notification importance. . As a result, the driver can grasp the presence of the notification object that has not been recognized and must be driven next most carefully, and safety is improved.

  As described above, according to the vehicle surrounding information display device of the first embodiment, when a plurality of notification targets are detected, it is possible to prevent a recognition failure or recognition delay of the notification target by the driver. Safety, which is the original purpose, is improved.

  Here, the notification target recognition presence / absence determination unit (gaze determination unit 35) of the first embodiment described above determines whether or not the driver has recognized the notification target displayed on the combiner 42, and is determined to be recognized. The notification target is configured to be excluded from the importance determination targets by the notification importance setting means 32. The reason why the configuration is excluded from the importance determination target is, for example, when the own vehicle follows the other vehicle ahead and continues to travel, it is determined that the notification importance is high for a certain notification target and is highlighted. Even though the driver recognizes this, the same notification target may be highlighted again after that, and the driver may be bothered about it.

  However, it is possible to grasp that the notification target that has been continuously detected for such a long time should always alert the driver. For this reason, the notification target recognition presence / absence determination means (line-of-sight determination means 35) described above does not necessarily have to be configured to exclude the notification target once determined to be recognized by the driver from the importance determination target. Alternatively, it may be configured to only determine whether or not the driver has recognized the notification target displayed on the combiner 42. In such a case, for the notification target recognized by the driver, the notification importance level is set to be lower than the notification target that is simultaneously detected at the time of the first detection and the new notification target that is subsequently detected. You may make it make the means 32 determine and produce | generate the notification information (for example, notification object frame of lower brightness than these) which is harder to recognize than these. In addition, for the notification target recognized by the driver, notification information (for example, a notification target frame having a luminance higher than these) that is more easily recognized than a notification target having a low notification importance when it is determined that the notification importance is high. ) May be generated.

  The notification importance level setting unit 32 according to the first embodiment is configured to gradually set the notification importance level for each detected notification target. It may be provided. For example, a person who crosses the traveling road of the own vehicle and a fallen object on the traveling path of the own vehicle are detected at the same time, and each of them is located at the same distance as the own vehicle. When the notification target is detected, these may be determined as the same notification importance. In addition, when the distance between the notification object that cannot be visually observed and the vehicle, and the distance between the human and the vehicle that can be visually observed but crossing the traveling path of the vehicle are equal to each other, , Any of them may be preferentially informed to the driver, and these may be determined as the same notification importance.

  Next, a second embodiment of the vehicle surrounding information display device according to the present invention will be described with reference to FIGS.

  For example, even if the notification importance level is set stepwise as in the first embodiment and notification information corresponding to the level is generated, the notification importance level of each detected notification target is the same level. Alternatively, when the levels are close, the brightness levels of the notification target frames to be generated are equal. In such a case, it is difficult to identify the level of importance of notification for each notification target from the notification target frame, and neither of them protrudes to stimulate the driver's vision. The line of sight is not always transferred to the notification target having the highest notification importance in the projected image.

  Therefore, in the second embodiment, in such a case, it is possible to determine the importance level of notification related to each notification target, that is, to recognize which notification target has a higher notification priority level. To do.

  For example, in the second embodiment, in the vehicle surrounding information display device of the first embodiment, to the driver of the respective notification information generated for each notification target set at the notification importance level of the same level or near level. The notification information generation means 33 is provided with a notification information correction function for emphasizing the difference between the identification levels.

  Here, it is assumed that another notification target 73 is detected in addition to the two notification targets 71 and 72 illustrated in the first embodiment as shown in FIG. In this case, the notification importance level setting means 32 of the second embodiment sets the notification importance levels “1b”, “1a”, and “1c” for the notification targets 71, 72, and 73, respectively. Assume that degrees “1a” to “1c” are close to each other.

  In this case, if it is the notification information generation means 33 of Example 1, as shown in the FIG. 8, each brightness | luminance of notification object frame 81c, 82c, 83c produced | generated with respect to each notification object 71,72,73 is shown. The level becomes the same, and it is difficult for the driver to determine which of the notification objects 71, 72, 73 should be most careful.

  On the other hand, in the case of the notification information generation means 33 of the second embodiment, the notification importance levels “1b”, “1a”, and “1c” of the notification targets 71, 72, and 73 are close to each other. In addition, the brightness level correction of the notification target frames 81c, 82c, and 83c is performed so as to make a difference between the brightness levels of the notification target frames 81c, 82c, and 83c on the basis of any one of them. For example, as shown in FIG. 9, the notification target 73 with the lowest notification importance is used as a reference, and the notification target 71 with the higher notification importance is at a glance compared to the notification target frame 83 c related to the notification target 73. To correct the notification target frame 81d with high brightness so that the difference can be discriminated. Further, for the notification target 72 having the second highest notification importance after the notification target 71, as shown in FIG. 9, the display processing means can distinguish the difference at a glance with respect to the notification target frame 81d related to the corrected notification target 71. 34 is corrected to a notification target frame 82d that can be blinked.

  As a result, the notification target 71 is highlighted than the notification target 73 having the lowest notification importance, and the notification target 72 is further highlighted than the notification target 71, so that the driver has the highest notification importance. A line of sight is guided to the notification target 72, and it is possible to drive with careful attention to the notification target 72.

  Here, the notification target to be used as a reference at the time of correction may be any notification target. For example, if the notification target 71 having an intermediate notification importance is used as a reference in the above example, the notification importance is higher than this. The low notification target 73 is corrected so as to reduce the luminance level of the notification target frame 83c.

  Further, in the second embodiment, the notification information is corrected to emphasize the difference between the notification targets, but correction is performed so as to emphasize each difference with respect to each determined notification importance, The notification importance level setting means 32 may be configured to set the notification importance level after correction as relating to each notification target.

  In the vehicle surrounding information display device of each of the first and second embodiments described above, the notification importance level of the notification target is determined using two types of imaging means (visible imaging means 10A and infrared imaging means 10B). However, for example, a high-resolution visual imaging unit 10A is prepared, and the notification importance level is determined based on the luminance of the notification target included in the video signal from the high-resolution visible imaging unit 10A. May be.

  Moreover, as notification information of each Example 1 and 2 mentioned above, it is not limited to the information appealing to the vision illustrated to these, You may use what stimulates other five senses. For example, a warning sound or the like as notification information may be generated when the above-described combiner 42 is highlighted with the notification target frame 82 or the like, and hearing may be stimulated by the warning sound or the like.

  Further, in each of the first and second embodiments described above, the visual imaging means 10A and the infrared imaging means 10B that image the front of the vehicle are exemplified as the vehicle surrounding information acquisition means. The vehicle surrounding information acquisition means is, for example, a vehicle It is also possible to take an image of the rear of the camera. In such a case, the present invention can be applied to a vehicle surrounding information display device such as a so-called back guide monitor. A radar device or the like may be used as the vehicle surrounding information acquisition means.

  Furthermore, although the head-up display device is exemplified as the display means 40 of each of the first and second embodiments described above, the present invention is not necessarily limited thereto. For example, in recent vehicles, a car navigation system has a high mounting ratio, and the car navigation system includes a monitor. Therefore, the monitor may be used as the display unit 40. In such a case, it is impossible to determine whether or not the driver has recognized the notification target from the line-of-sight detection means 20 and the line-of-sight determination means 35 configured as described above. For this reason, when such a monitor is used as the display means 40, the monitor is configured to have a so-called touch panel function, and the display section of the monitor touched by the driver and the notification target are displayed. A notification object recognition presence / absence determination unit is configured to determine whether or not the driver recognizes the notification target by comparing with the section.

  As described above, the vehicle surroundings information display device according to the present invention is useful as a technique when a plurality of notification targets are detected at the same time. In particular, all of the notification targets are individually and clearly displayed to the driver. It is suitable for the technology to let you know.

It is a figure which shows the structure of Example 1 of the vehicle surroundings information display apparatus which concerns on this invention. It is a figure which shows the structure of the display means of the vehicle surroundings information display apparatus in Example 1, and a gaze detection means. 6 is a flowchart for explaining a calculation processing operation of the vehicle surroundings information display device according to the first embodiment. It is a figure which shows an example of the actual scene seen through a front windshield in the vehicle surroundings information display apparatus in Example 1, and the image of the head-up display displayed on the said front windshield, Comprising: For convenience, the image of the head-up display is expanded. FIG. It is a figure which shows about the alerting | reporting object frame of the head-up display displayed after detecting several alerting | reporting object shown in FIG. 4, and setting these alerting | reporting importance. FIG. 6 is a diagram illustrating a notification target frame of a head-up display that is displayed after the highlighted notification target illustrated in FIG. 5 is recognized by a driver. It is a figure shown about the alerting | reporting object frame of the head-up display displayed after a driver | operator recognizes all the some alerting | reporting objects shown in FIG. It is a figure for showing the difference of the vehicle surroundings information display apparatus in Example 1 and Example 2, Comprising: The actual scene which can be seen through a front windshield in Example 2, and this actual scene of the vehicle surroundings information display apparatus in Example 1 It is a figure which shows an example at the time of displaying as an image of a head-up display. FIG. 9 is a diagram illustrating a corrected notification target frame in the head-up display that is displayed when it is determined that the notification importance levels of the plurality of notification targets illustrated in FIG.

Explanation of symbols

10A Visible imaging means (vehicle surrounding information acquisition means)
10B Infrared imaging means (vehicle surrounding information acquisition means)
20 gaze detection means 30 control means 31 notification target detection means 32 notification importance setting means 33 notification information generation means 34 display processing means 35 gaze determination means 40 display means 41 HUD unit 42 combiner 61 front windshield 71, 72, 73 notification target 81, 81a, 81b, 81c, 81d, 82, 82a, 82c, 82d, 83c Notification target frame

Claims (7)

  1. Vehicle surrounding information acquisition means for acquiring vehicle surrounding information, notification target detection means for detecting a notification target for a driver around the vehicle based on vehicle surrounding information from the vehicle surrounding information acquisition means, and the notification target detection means In the vehicle surrounding information display device comprising display means for displaying the information of the notification target detected by
    A notification importance level setting unit that sets notification importance levels of a plurality of notification targets detected by the notification target detection unit; and notification information generation unit that generates notification information to the driver related to the notification target;
    The notification information generating means is configured to generate notification information that is easier to stimulate the driver's five senses for a notification target having a high notification importance than for a notification target having a low notification importance. Ambient information display device.
  2.   2. The vehicle surrounding information display device according to claim 1, wherein the notification importance setting means is configured to set the level of notification importance in a stepwise manner for each detected notification target.
  3.   A notification target recognition presence / absence determination unit is provided for determining whether or not the driver has recognized the notification target displayed on the display unit, and excluding the notification target determined to be recognized from the determination target of the notification importance setting unit. The vehicle surrounding information display device according to claim 1, wherein the vehicle surrounding information display device is provided.
  4.   The notification information generation unit is configured to generate notification information that is less likely to stimulate the senses than the notification target determined to be unrecognized for the notification target determined to be recognized by the notification target recognition presence determination unit. The vehicle surrounding information display device according to claim 3.
  5. A notification object recognition presence / absence determination means for determining whether or not the driver has recognized the notification object displayed on the display means;
    The notification information generation unit is configured to generate notification information that is less likely to stimulate the senses than the notification target determined to be unrecognized for the notification target determined to be recognized by the notification target recognition presence determination unit. The vehicle surrounding information display device according to claim 1 or 2.
  6.   6. The vehicle surroundings according to any one of claims 1 to 5, wherein the notification information generated by the notification information generation means is displayed on the display means and appeals to the driver's vision. Information display device.
  7.   The notification information generated by the notification information generating unit for the notification target having a high notification importance is displayed on the display unit with a higher brightness than the notification target having the low notification importance or the display unit. The vehicle surrounding information display device according to claim 1, 2, 3, or 4, wherein the vehicle surrounding information display device is displayed in a blinking manner.
JP2005278551A 2005-09-26 2005-09-26 Vehicle peripheral information display device Pending JP2007087337A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2005278551A JP2007087337A (en) 2005-09-26 2005-09-26 Vehicle peripheral information display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005278551A JP2007087337A (en) 2005-09-26 2005-09-26 Vehicle peripheral information display device

Publications (1)

Publication Number Publication Date
JP2007087337A true JP2007087337A (en) 2007-04-05

Family

ID=37974232

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005278551A Pending JP2007087337A (en) 2005-09-26 2005-09-26 Vehicle peripheral information display device

Country Status (1)

Country Link
JP (1) JP2007087337A (en)

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008120748A1 (en) 2007-03-29 2008-10-09 Ihi Corporation Wall of turbo machine and turbo machine
JP2009196630A (en) * 2008-01-25 2009-09-03 Denso Corp Display device
JP2010105443A (en) * 2008-10-28 2010-05-13 Denso Corp Visual assistive device
JP2010108507A (en) * 2009-11-05 2010-05-13 Honda Motor Co Ltd Vehicle periphery monitoring device
JP2010120617A (en) * 2008-11-24 2010-06-03 Denso Corp Image forming device, head-up display, and vehicle display
JP2010161736A (en) * 2009-01-09 2010-07-22 Toyota Motor Corp Night vision system
JP2011245900A (en) * 2010-05-24 2011-12-08 Yazaki Corp Vehicular display device
EP2402226A1 (en) * 2010-07-02 2012-01-04 Harman Becker Automotive Systems GmbH Computer based system and method for providing a driver assist information
WO2012077202A1 (en) * 2010-12-08 2012-06-14 トヨタ自動車株式会社 Information conveyance device for use in vehicle
JP2013088894A (en) * 2011-10-14 2013-05-13 Honda Motor Co Ltd Drive support device of vehicle
JP2013216315A (en) * 2013-05-14 2013-10-24 Denso Corp Image generation device
JP2014238708A (en) * 2013-06-07 2014-12-18 株式会社デンソー Vehicle warning device
JP2015009676A (en) * 2013-06-28 2015-01-19 株式会社デンソー Information provision device and information provision method
JP5664784B2 (en) * 2011-07-21 2015-02-04 トヨタ自動車株式会社 Vehicle information transmission device
CN104742746A (en) * 2013-12-27 2015-07-01 丰田自动车株式会社 Vehicle information display device and vehicle information display method
JP2015191641A (en) * 2014-03-31 2015-11-02 Necエンベデッドプロダクツ株式会社 Monitoring device, monitoring system, monitoring method, and program
WO2016002006A1 (en) * 2014-07-01 2016-01-07 日産自動車株式会社 Display device for vehicle and display method for vehicle
JP2016024574A (en) * 2014-07-18 2016-02-08 日産自動車株式会社 Display device for vehicle
JP2016038866A (en) * 2014-08-11 2016-03-22 トヨタ自動車株式会社 Recognition support device
WO2016147547A1 (en) * 2015-03-16 2016-09-22 株式会社デンソー Image generation device
JP2017004181A (en) * 2015-06-08 2017-01-05 富士通テン株式会社 Obstacle alarm system and obstacle alarm system method
JPWO2015037117A1 (en) * 2013-09-13 2017-03-02 日立マクセル株式会社 Information display system and information display device
WO2017145565A1 (en) * 2016-02-22 2017-08-31 富士フイルム株式会社 Projection-type display device, projection display method, and projection display program
JP2017178157A (en) * 2016-03-31 2017-10-05 株式会社Subaru Vehicle periphery monitoring device
JP2017532644A (en) * 2014-10-06 2017-11-02 トヨタ自動車株式会社 A safety system that emphasizes road objects on a head-up display
US9852632B2 (en) 2012-02-10 2017-12-26 Mitsubishi Electric Corporation Driving assistance device and driving assistance method
JP2018032402A (en) * 2016-08-23 2018-03-01 トヨタ自動車株式会社 System for occlusion adjustment for in-vehicle augmented reality systems
US10150415B2 (en) 2014-08-25 2018-12-11 Hyundai Motor Company Method and apparatus for detecting a pedestrian by a vehicle during night driving
EP2922293B1 (en) * 2014-03-20 2020-01-08 MAN Truck & Bus SE Method for monitoring the vehicle interior and the vehicle exterior

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0761257A (en) * 1993-08-26 1995-03-07 Nissan Motor Co Ltd Display device for vehicle
JP2002074594A (en) * 2000-08-25 2002-03-15 Alpine Electronics Inc Obstacle detecting system
JP2003291688A (en) * 2002-04-03 2003-10-15 Denso Corp Display method, driving support device and program
JP2005222153A (en) * 2004-02-03 2005-08-18 Japan Science & Technology Agency System, method, and program for human support

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0761257A (en) * 1993-08-26 1995-03-07 Nissan Motor Co Ltd Display device for vehicle
JP2002074594A (en) * 2000-08-25 2002-03-15 Alpine Electronics Inc Obstacle detecting system
JP2003291688A (en) * 2002-04-03 2003-10-15 Denso Corp Display method, driving support device and program
JP2005222153A (en) * 2004-02-03 2005-08-18 Japan Science & Technology Agency System, method, and program for human support

Cited By (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008120748A1 (en) 2007-03-29 2008-10-09 Ihi Corporation Wall of turbo machine and turbo machine
JP2009196630A (en) * 2008-01-25 2009-09-03 Denso Corp Display device
JP2010105443A (en) * 2008-10-28 2010-05-13 Denso Corp Visual assistive device
JP2010120617A (en) * 2008-11-24 2010-06-03 Denso Corp Image forming device, head-up display, and vehicle display
JP2010161736A (en) * 2009-01-09 2010-07-22 Toyota Motor Corp Night vision system
JP2010108507A (en) * 2009-11-05 2010-05-13 Honda Motor Co Ltd Vehicle periphery monitoring device
JP4615061B2 (en) * 2009-11-05 2011-01-19 本田技研工業株式会社 Vehicle periphery monitoring device
JP2011245900A (en) * 2010-05-24 2011-12-08 Yazaki Corp Vehicular display device
US8803675B2 (en) 2010-05-24 2014-08-12 Yazaki Corporation Display apparatus for vehicle
EP2402226A1 (en) * 2010-07-02 2012-01-04 Harman Becker Automotive Systems GmbH Computer based system and method for providing a driver assist information
WO2012077202A1 (en) * 2010-12-08 2012-06-14 トヨタ自動車株式会社 Information conveyance device for use in vehicle
CN103250194A (en) * 2010-12-08 2013-08-14 丰田自动车株式会社 Information conveyance device for use in vehicle
EP2736028A4 (en) * 2011-07-21 2015-05-06 Toyota Motor Co Ltd Vehicle information transmitting apparatus
JP5664784B2 (en) * 2011-07-21 2015-02-04 トヨタ自動車株式会社 Vehicle information transmission device
US9384649B2 (en) 2011-07-21 2016-07-05 Toyota Jidosha Kabushiki Kaisha Vehicle information transmitting apparatus
JP2013088894A (en) * 2011-10-14 2013-05-13 Honda Motor Co Ltd Drive support device of vehicle
US9852632B2 (en) 2012-02-10 2017-12-26 Mitsubishi Electric Corporation Driving assistance device and driving assistance method
JP2013216315A (en) * 2013-05-14 2013-10-24 Denso Corp Image generation device
JP2014238708A (en) * 2013-06-07 2014-12-18 株式会社デンソー Vehicle warning device
JP2015009676A (en) * 2013-06-28 2015-01-19 株式会社デンソー Information provision device and information provision method
JPWO2015037117A1 (en) * 2013-09-13 2017-03-02 日立マクセル株式会社 Information display system and information display device
EP2894621A1 (en) * 2013-12-27 2015-07-15 Toyota Jidosha Kabushiki Kaisha Vehicle information display device and vehicle information display method
US9875562B2 (en) 2013-12-27 2018-01-23 Toyota Jidosha Kabushiki Kaisha Vehicle information display device and vehicle information display method
CN104742746A (en) * 2013-12-27 2015-07-01 丰田自动车株式会社 Vehicle information display device and vehicle information display method
JP2015128201A (en) * 2013-12-27 2015-07-09 トヨタ自動車株式会社 Vehicular information display apparatus and vehicular information display method
EP2922293B1 (en) * 2014-03-20 2020-01-08 MAN Truck & Bus SE Method for monitoring the vehicle interior and the vehicle exterior
JP2015191641A (en) * 2014-03-31 2015-11-02 Necエンベデッドプロダクツ株式会社 Monitoring device, monitoring system, monitoring method, and program
WO2016002006A1 (en) * 2014-07-01 2016-01-07 日産自動車株式会社 Display device for vehicle and display method for vehicle
JPWO2016002006A1 (en) * 2014-07-01 2017-04-27 日産自動車株式会社 Display device for vehicle and display method for vehicle
JP2016024574A (en) * 2014-07-18 2016-02-08 日産自動車株式会社 Display device for vehicle
JP2016038866A (en) * 2014-08-11 2016-03-22 トヨタ自動車株式会社 Recognition support device
US10391937B2 (en) 2014-08-25 2019-08-27 Hyundai Motor Company Method and apparatus for detecting a pedestrian by a vehicle during night driving
US10150415B2 (en) 2014-08-25 2018-12-11 Hyundai Motor Company Method and apparatus for detecting a pedestrian by a vehicle during night driving
JP2017532644A (en) * 2014-10-06 2017-11-02 トヨタ自動車株式会社 A safety system that emphasizes road objects on a head-up display
WO2016147547A1 (en) * 2015-03-16 2016-09-22 株式会社デンソー Image generation device
JP2016172469A (en) * 2015-03-16 2016-09-29 株式会社デンソー Image forming apparatus
US10005392B2 (en) 2015-06-08 2018-06-26 Fujitsu Ten Limited Object alarm device and object alarm method
JP2017004181A (en) * 2015-06-08 2017-01-05 富士通テン株式会社 Obstacle alarm system and obstacle alarm system method
WO2017145565A1 (en) * 2016-02-22 2017-08-31 富士フイルム株式会社 Projection-type display device, projection display method, and projection display program
US10556540B2 (en) 2016-03-31 2020-02-11 Subaru Corporation Vehicle surroundings monitoring apparatus
JP2017178157A (en) * 2016-03-31 2017-10-05 株式会社Subaru Vehicle periphery monitoring device
US10248196B2 (en) 2016-08-23 2019-04-02 Toyota Jidosha Kabushiki Kaisha System for occlusion adjustment for in-vehicle augmented reality systems
JP2018032402A (en) * 2016-08-23 2018-03-01 トヨタ自動車株式会社 System for occlusion adjustment for in-vehicle augmented reality systems

Similar Documents

Publication Publication Date Title
US9824285B2 (en) Vehicular control system
US10286843B2 (en) Vehicle vision system
US10315573B2 (en) Method for displaying information to vehicle driver
EP3040809B1 (en) Method and system for controlling a human-machine interface having at least two displays
JP6485732B2 (en) Information providing apparatus, information providing method, and information providing control program
US20150296135A1 (en) Vehicle vision system with driver monitoring
US9174567B2 (en) Motor vehicle having a device for influencing the viewing direction of the driver
US10065503B2 (en) Vehicular display control device
JP5406328B2 (en) Vehicle display device, its control method and program
US9321399B2 (en) Surrounding area monitoring device for vehicle
JP2016196289A (en) Information presentation device
CN102910130B (en) Forewarn system is assisted in a kind of driving of real enhancement mode
US9077861B2 (en) Image processing apparatus, electronic apparatus, and image processing method
US20140139655A1 (en) Driver distraction and drowsiness warning and sleepiness reduction for accident avoidance
US8237909B2 (en) Vehicular rearview mirror assembly including integrated backlighting for a liquid crystal display (LCD)
DE102004050181B4 (en) Active night vision system with adaptive imaging
US7519459B2 (en) Driving assistance system
JP5162132B2 (en) Method and system for displaying information
US10272780B2 (en) Information display system and information display device
US7209833B2 (en) Collision possibility determination device
US6304187B1 (en) Method and device for detecting drowsiness and preventing a driver of a motor vehicle from falling asleep
CN103582906B (en) Vehicular field of view assistance
DE102008029916B4 (en) Image display device and image display system for a vehicle
EP3148845B1 (en) Vehicle display device, display control method, and rearview monitoring system
JP5664784B2 (en) Vehicle information transmission device

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20080623

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20101203

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20101207

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20110405