JP4200974B2 - Vehicle display device - Google Patents

Description

  The present invention relates to a vehicular display device that clearly displays a thing that may be dangerous for a driver according to the surroundings of the own vehicle, the situation of the own vehicle, the situation of the driver, and the like.

  Conventionally, an object (for example, a pedestrian) that can be dangerous to the driver is detected from an image captured by an infrared camera, and the object is displayed in a manner surrounded by a frame, for example. An obstacle detection device that recognizes the existence has been proposed (see, for example, Patent Document 1).

  The obstacle detection device includes an infrared camera, an image processing unit, and an image display device. The image processing unit has a function of detecting a target object that may be dangerous from the video captured by the infrared camera, and performing a process of clearly displaying the target object.

  Specifically, the image unit determines whether or not the shape of the object in the video corresponds to a registered shape that is registered in advance as something that can be dangerous for the driver. When the shape of the target object corresponds to the registered shape, the image processing unit performs a process of displaying the target object in a video by surrounding it with a frame, for example, and outputs the processing result to the image display device. Then, the image display device superimposes and displays a frame surrounding an object that may be dangerous for the driver in the video imaged by the infrared camera.

In this way, when there is an object that can be dangerous for the driver in the image captured by the infrared camera, the object is clearly indicated by being surrounded by a frame so that the driver can be aware of the presence. Can be.
JP 2004-106682 A

  However, in the above conventional technique, all the objects present in the video are detected and all of them are displayed with a frame. In other words, since all the objects in the image are displayed surrounded by a frame, multiple frames are displayed in the image, making it difficult to understand which object is really dangerous for the driver. It was. If a plurality of frames are displayed, the driver may not recognize all the frames and may miss them.

  Furthermore, when a plurality of frames are displayed in the video, it is difficult to see the scenery photographed by the infrared camera, which causes trouble for the driver.

  In the present invention, in view of the above points, when an object that can be dangerous for a driver exists in an image captured by an infrared camera, the vehicle can clearly indicate the object in accordance with a situation in which the driver drives. An object of the present invention is to provide a display device for use.

In order to achieve the above object, according to the first aspect of the present invention, an object (80) that may be dangerous for the driver is detected from an image input from a camera (10) that captures the front of the host vehicle. In addition, a detection unit (20) that outputs at least coordinate and size data of the object, and a weight detection unit (30) that detects and outputs information about the vehicle periphery, the vehicle, the driver, and the object as parameters. And a weighting coefficient corresponding to the state quantity is set in advance, and the weighting coefficient corresponding to each of the plurality of weighting parameters detected by the weight detection unit is included in the video based on the relationship between the state quantity and the weighting coefficient. A weighting calculation is performed on each target object, and when the numerical value of the calculation result exceeds a threshold value, a warning image (90) for clearly displaying the target object is generated. Parts (40), against the image photographed by the camera, a display unit for displaying an image by superimposing alert image in a position where the object is present (50), has the weight detection unit is operating A personal information input device for inputting the age of the driver, and the alerting unit is set with a weighting factor according to the age of the driver, and the individual detected by the personal information input device during the weighting calculation A weighting operation is performed using a weighting factor corresponding to the age of the driver, which is information, and it is determined whether or not the presence of the object should be notified from the operation result .

  In this way, information related to the own vehicle is detected as a weighting parameter, a weighting calculation is performed using the corresponding weighting coefficient, and it is determined whether or not the presence of the object should be notified from the calculation result. Thereby, according to the situation of the own vehicle or the driver, the presence of the object in the video can be notified. Moreover, even if there are a plurality of objects in the video, only the objects that can be dangerous for the driver can be clearly displayed. Therefore, the driver can be alerted according to the situation.

  Further, by not displaying a plurality of alert images in the video as described above, it is possible to display the scenery photographed by the camera without bothering the driver.

  In the invention according to claim 2, the alerting unit is set with a plurality of stages of alerting processing according to the magnitude of the numerical value of the computation result, and the alerting unit targets the driver from the computation result. When it is determined that the presence of an object should be notified, a warning process at a stage corresponding to the magnitude of the numerical value of the calculation result is selected, and image data of the warning image is created based on the warning process. It is characterized by that.

  Thus, a plurality of stages of alerting processing are set according to the numerical value of the calculation result. Accordingly, a plurality of degrees to be recognized by the driver can be prepared according to each stage. That is, it is possible to perform a process of creating a warning image that informs the driver of the presence of the target object sooner or a process of creating a warning image that notifies the driver of the presence of the target object. Therefore, it is possible to call attention according to the situation.

  In the invention according to claim 3, the detection unit is configured to detect a moving object as an object, and the alerting unit includes a weighting factor that varies depending on the moving direction of the moving object detected by the detection unit. Is set.

  Thus, different weighting factors are set according to the moving direction of the moving object. For example, when the moving object approaches the own vehicle, the moving object may be dangerous for the own vehicle, and therefore the value of the weighting factor is set large. On the contrary, when the moving object moves away from the own vehicle, the moving object is not dangerous, so a value smaller than the weight coefficient is set. Thereby, the calculation part according to the movement of a moving object can be calculated | required in the alerting part, and the alerting of the stage according to the calculation result can be performed.

  In addition, the code | symbol in the bracket | parenthesis of each said means shows the correspondence with the specific means as described in embodiment mentioned later.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram of a vehicle display device according to an embodiment of the present invention. As shown in FIG. 1, the vehicle display device includes an infrared camera 10, a detection unit 20, a weight detection unit 30, an alerting unit 40, and a display unit 50.

  The infrared camera 10 is a camera that captures images in front of the vehicle, and captures, for example, 30 images per second. These images are displayed continuously and recognized as images by the driver. A signal of a video ahead of the vehicle photographed by the infrared camera 10 is converted into an NTSC signal that is a video signal and then output to the detection unit 20 and the display unit 50. The infrared camera 10 corresponds to the camera of the present invention.

  The detection unit 20 detects an object that can be dangerous for the driver from the image captured by the infrared camera 10. Specifically, the detection unit 20 includes a microcomputer, and stores in advance the shape of an object that can be dangerous for the driver. In this embodiment, a person (pedestrian) is detected as an object. In the detection unit 20, so-called pattern matching is performed, and an object is detected from an image captured by the infrared camera 10. Then, the coordinates and size of the object detected by the detection unit 20 are output to the alerting unit 40.

  The weight detection unit 30 detects each of a plurality of state quantities represented by information around the host vehicle, host vehicle information, driver information, and object information as weighting parameters. That is, a plurality of weighting parameters are detected and output as determination materials for determining which object is dangerous for the driver. In this embodiment, the weighting parameter is a detection signal. Hereinafter, each situation and the means for detecting these situations will be described.

  The situation (state quantity) around the vehicle refers to the situation such as weather, ambient brightness, traveling road, oncoming vehicle, guardrail, and the like. In order to detect these situations, the weight detection unit 30 includes a wiper switch, a conlight IC, a navigation system, and a radar.

  The wiper switch is a switch that controls start and stop of a wiper for wiping raindrops attached to glass such as a front windshield in order to secure a driver's field of view. A state in which the wiper switch is activated or deactivated is output as a detection signal. In this embodiment, when the wiper switch is not operated, it is clear, and when it is operated, it is rained.

  The conlight IC is an IC that controls turning on or off of the headlight with ambient brightness. The operation state or non-operation state of the concrite IC is output as a detection signal. In the present embodiment, it is assumed that when the conlite IC is activated, it is bright, and when it is not activated, it is dark.

  The navigation system outputs map data relating to a road on which a vehicle is operating based on map data stored in a built-in storage medium such as a DVD, and includes a GPS antenna. The navigation system identifies the latitude and longitude of the vehicle based on the side signal input from the GPS antenna, obtains the current position of the vehicle, searches for the optimal map data for vehicle operation, and outputs the map data To do. Therefore, the travel location (city area, suburb, etc.) of the vehicle is output as a detection signal by the navigation system.

  The radar detects a distance between an object in front of the vehicle and the own vehicle. Specifically, the radar transmits a pulse modulation signal in front of the vehicle and receives a reflected wave reflected by an obstacle positioned in front of the vehicle. Then, the time from transmission of the pulse modulation signal to reception of the reflected wave from the obstacle is obtained, and the distance between the object in front of the vehicle and the host vehicle is obtained by multiplying the half of this time by the speed of light. To get. Therefore, the distance detected by the radar is output as a detection signal.

  The state (state quantity) of the own vehicle refers to the vehicle speed, the traveling direction of the own vehicle, and the state of following the front vehicle. In order to detect these situations, the weight detection unit 30 includes a vehicle speed sensor, a direction sensor, a steering sensor, the navigation system described above, and a front vehicle following ECU.

  The vehicle speed sensor detects a vehicle speed and outputs a pulse signal corresponding to the vehicle speed. This pulse signal is converted into a vehicle speed. Therefore, the vehicle speed obtained from the pulse signal is output as a detection signal.

  The direction sensor detects in which direction the vehicle is operating, and is composed of, for example, a yaw rate sensor or a gyro sensor. Specifically, the direction sensor detects the vehicle rotation angle around the vertical axis passing through the center of gravity of the vehicle by the yaw rate sensor, detects the inclination of the road by the gyro sensor, and outputs the direction signal related to the driving direction of the vehicle based on these To do. The steering sensor detects the steering angle when the driver operates the steering. This steering sensor is provided in a steering gear box, for example, and outputs a signal corresponding to the steering angle of the steering. Then, the steering angle signal is converted into the steering angle of the steering. Furthermore, the navigation system described above detects the lane in which the host vehicle is traveling as a lane signal. Therefore, the direction signal, the steering angle signal, and the lane signal obtained by the direction sensor, the steering sensor, and the navigation system are output as detection signals.

  The front vehicle follow-up ECU performs control to follow the preceding vehicle while maintaining a constant distance between the preceding vehicle and the own vehicle. The inter-vehicle distance between the preceding vehicle and the own vehicle set by the driver The vehicle speed, brakes, etc. are controlled based on the vehicle speed. The operating or non-operating state of the front vehicle following ECU is output as a detection signal.

  The situation of the driver (state quantity) refers to the situation of the driver's personal information, fatigue, and presence / absence of recognition. In order to detect these situations, the weight detection unit 30 includes a personal information input device and an in-vehicle camera.

  The personal information input device is a device for inputting the driver's personal information. Specifically, the driver's age (experienced, beginner), visual acuity, athletic ability, and the like are input. In this embodiment, age is adopted as personal information. Therefore, the age of the driver input by the personal information input device is output as a detection signal. If personal information is built into the license in the future, the personal information of the license may be read.

  The in-vehicle camera is a camera that photographs a driver's face, and is installed, for example, on an instrument panel. This in-vehicle camera images the movement of the driver's face and eyes, and detects the driver's fatigue and presence / absence of recognition according to the direction of the face and eyes. For example, it can be said that fatigue appears when the line of sight faces the ground. In addition, when the vehicle turns right or left, it can be said that there is recognition or non-recognition when the face is facing in a turning direction. Therefore, the direction of the driver's face and eyes obtained with the in-vehicle camera is output as a detection signal.

  The situation (state quantity) of the object refers to an object that can be dangerous for the driver, that is, the position of the pedestrian and the situation in the traveling direction. In order to detect these situations, the weight detection unit 30 is provided with a microcomputer, and the position (coordinate) data of the object in the video is input from the detection unit 20 to the microcomputer.

  In the present embodiment, the ranges are A, B, and C according to the distance from the host vehicle in the range ahead of the subject vehicle. For example, the road area ahead of the vehicle in the lane in which the vehicle is traveling is defined as range A, the area surrounding range A (for example, a sidewalk) is range B, and the area surrounding range B (for example, a position farther than the sidewalk) is range C. And Then, it is determined by the microcomputer which range of the above-mentioned range the coordinates of the object input from the detection unit 20 belong, and the range to which the object belongs is output as a detection signal.

  Further, the behavior of the object, that is, the traveling direction is detected by the change in the coordinates of the object. That is, the traveling direction of the object is output as a detection signal.

  As described above, each situation is detected by the weight detection unit 30 as a detection signal, and each detection signal is output to the alerting unit 40.

  In the alerting unit 40, a weighting factor corresponding to the state quantity is set in advance, and the weighting factor corresponding to each of the plurality of detection signals detected by the weight detecting unit 30 is determined from the relationship between the state quantity and the weighting factor. Processing for performing a weighting operation on each object included in the video and creating a warning image for clearly displaying the object based on the coordinates and size of the object input from the detection unit 20 Is to do. In the present embodiment, a frame is employed as the alert image.

  Specifically, a weighting coefficient is assigned to each detection signal input from the weight detection unit 30 to the alerting unit 40 according to each situation. In other words, the value of the weighting factor given to the detection signal increases as the situation in which the driver should be alerted. In the alerting unit 40, weighting coefficients are given to all the input detection signals, and weighting calculation is performed using all the weighting coefficients. In this embodiment, the product of all weights is obtained as an operation. And the alerting process according to the calculation result is performed.

  In the present embodiment, the alerting process performed by the alerting unit 40 includes three patterns of “advance alerting process”, “low alerting process”, and “not alerting process”. Among these, when high level alert and low level alert are performed, a frame for clearly displaying the target object is created in the alert unit 40, and it is determined that no alert is issued from the calculation result of weighting. The frame surrounding the object is not created.

  In the high-level alerting process and the low-level alerting process, image data indicating the coordinates, color, size, and brightness of the frame is created based on the coordinates and size of the object input from the detection unit 20. This image data is data in which only a frame is drawn in the same size as the size of the video shot by the infrared camera 10.

  In the case of advanced alerting, the image data of the frame is formed so that the line of the frame is thick, red, and blinking. On the other hand, in the case of low-level alerting, a frame surrounding the object is created based on the coordinates and size of the object input from the detection unit 20.

  As described above, the detection signal input from the weight detection unit 30 to the alerting unit 40 is weighted, and the alerting pattern is selected from the product of all weight values. Then, a frame corresponding to the alerting pattern is created, and image data of an image in which the frame is drawn is output to the display unit 50. If no frame is created, nothing is output from the alerting unit 40 to the display unit 50.

  The display unit 50 displays an image captured by the infrared camera 10 and includes a drawing unit 60 and a display 70.

  The drawing unit 60 inputs an NTSC signal that is a video signal from the infrared camera 10 and outputs the NTSC signal to the display unit 70. In addition, the drawing unit 60 includes a microcomputer for inputting image data of an image in which only a frame is drawn from the alerting unit 40 and performing processing for superimposing and displaying the image on the video of the infrared camera 10.

  The display 70 displays the NTSC signal input from the drawing unit 60 as an image, and is configured by a head-up display. FIG. 2 is a schematic configuration diagram of the head-up display. FIG. 3 is a schematic diagram when the head-up display is used.

  As shown in FIG. 2, the head-up display includes an image projector 71 that emits image light of an image, a plane mirror 72 that reflects image light emitted from the image projector 71, and an image reflected by the plane mirror 72. A magnifying mirror 73 that expands the light and guides it to the front windshield WS, an image display unit 74 for displaying the image light guided from the magnifying mirror 73, and a case 75 are provided.

  The image projector 71 outputs image light of an image displayed on the image display unit 74 of the front windshield WS, and includes an LED as a light source and a TFT liquid crystal panel. In such an image projector 71, when light is emitted from the light source and an NTSC signal is input from the drawing unit 60 to the TFT liquid crystal panel, an image is displayed on the TFT liquid crystal panel and the image light of the image is displayed. Is ejected.

  The plane mirror 72 is a mirror that is disposed at a position facing the image light projection surface of the image projector 71 and reflects the image light emitted from the image projector 71 to the magnifier 73. The angle of the plane mirror 72 is fixed, and the image light from the image projector 71 is always guided to the magnifier 73.

  The magnifying mirror 73 is a mirror that reflects the image light guided from the plane mirror 72 and emits the image light from an opening provided above the instrument panel IP to guide it to the front windshield WS. A side of the magnifying glass 73 is provided with a gear (not shown) and a motor for driving the gear. When a signal is input from an operation panel (not shown), the angle of the magnifying glass 73 is changed. Thereby, the size of the image displayed on the image display unit 74 of the front windshield WS can be adjusted so that it can be easily seen by the driver.

  The image display unit 74 is an image display region provided on the inner surface of the front windshield WS that displays the image light guided from the magnifying glass 73 as an image.

  Among such displays 70, the image projector 71, the plane mirror 72, and the magnifying glass 73 are housed in a case 75, and are installed in the instrument panel IP as shown in FIG.

  The above is the configuration of the vehicle display device according to the present embodiment.

  Next, the operation of the vehicle display device will be described. First, when an image in front of the vehicle is captured by the infrared camera 10, the image signal of the image is input as an NTSC signal to the image projector 71 of the display 70 via the drawing unit 60 of the display unit 50. An image is displayed on the image projector 71, and image light of an image constituting the image is emitted from the image projector 71. The emitted image light is emitted from an opening provided in the upper part of the instrument panel IP through the plane mirror 72 and the magnifying mirror 73 and is imaged on the inner surface of the front windshield WS. Specifically, the magnifying glass 73 forms an image of the image projector 71 as a virtual image, and forms this virtual image on the inner surface of the front windshield WS. As a result, the driver can visually recognize the image displayed on the image display unit 74 of the front windshield WS.

  Subsequently, when an object that can be dangerous for the driver is reflected in the video imaged by the infrared camera 10, a process for calling attention according to the situation of the driver or the vehicle will be described. First, the NTSC signal of the video imaged by the infrared camera 10 is input to the display unit 50 and the detection unit 20.

  When the NTSC signal is input to the detection unit 20, the coordinates and size of the person are detected from the image captured by the infrared camera 10 by the pattern matching method. Then, the detected coordinates and size data of the person are input to the alerting unit 40. When pattern matching is performed in this way, when a plurality of persons are detected in the video, data of respective coordinates and sizes are input to the alerting unit 40.

  On the other hand, the weight detection unit 30 detects the situation around the vehicle, the situation of the host vehicle, the situation of the driver, and the situation of the object, respectively, and the detected signals respectively input to the alerting unit 40. The

  Subsequently, a weight corresponding to each detection signal is given. The value of this weight is set in advance in the alerting unit 40, and is specifically shown in the left column of the table of FIG. FIG. 4 is a diagram illustrating a table in which weights are set for the respective detection signals detected by the weight detection unit 30 and examples of weights.

  For example, when the position of the object (pedestrian) is located in the range A, that is, the roadway (or lane) on which the host vehicle is traveling, the weight is set to “10”. Further, “5” is set in the range B which is a sidewalk, and “1” is set in the range C which is a position farther from the sidewalk. Thus, in a situation where a pedestrian is present in front of the host vehicle, the weighting varies depending on the range to which the pedestrian belongs. The value of the weight in a situation where the driver should be informed of the presence of a pedestrian is set large as in range A.

  Further, when the road on which the vehicle is traveling in the weight detection unit 30 is an automobile road, there is no pedestrian, so the weight is “0”, the weight when there is a general walkway is “1”, and the general walkway is When there is no weight, the weight is set to “1.5”. In this way, when the vehicle is traveling on a motorway, there is no danger of pedestrians, so the weight value is 0, and pedestrians for the vehicle as in the case where there is no general sidewalk. In situations where this can be dangerous, the weight value is 1.5.

  Furthermore, when the pedestrian travels straight, the weight is “1”. Similarly, the weight is “0.5” when the pedestrian is opposite to the own vehicle because the pedestrian is not dangerous, and the weight is “1. 2 ”.

  As in the above example, weighting is set for each detection signal detected by the weight detection unit 30.

  Then, using the weight values shown in the left column of the table of FIG. 4, as shown in Examples 1 to 3 in the right column, weighting operations, that is, products of all weights, were calculated for the three examples. As a result, in Example 1, the calculation result was “12.96”, in Example 2, “2.4”, and in Example 3, “1”.

  In the present embodiment, when the weighted calculation result A is 10 <A, it is assumed that an advanced alert is performed. Similarly, when the calculation result A is 2 ≦ A <10, low-level alerting is performed. Further, when the calculation result A is A <2, alerting is not performed. Therefore, the alerting process according to the calculation result is performed by the alerting unit 40.

  Specifically, in the case of Example 1, since the calculation result is 12.96, the advanced alerting process is performed by the alerting unit 40. That is, based on the coordinates and size of the object input from the detection unit 20, image data in which a frame surrounding the object is drawn is created. In the advanced alert process, the frame surrounding the object is made thick and red. Then, image data of the frame is created so that the frame is blinked.

  In the case of Example 2, since the calculation result is 2.4, the low-level attention calling process is performed by the attention calling unit 40. In the low-level alerting process, image data in which a frame surrounding the object is drawn is created. Further, in the case of Example 3, since the calculation result is 1, no alert is made and no frame image data is created.

  As described above, the frame image data created by the alerting unit 40 based on the calculation results of Example 1 and Example 2 is input to the drawing unit 60 of the display unit 50. In the drawing unit 60, a video is generated by superimposing the frame image input from the alerting unit 40 on the video input from the infrared camera 10. Then, the video data is input from the drawing unit 60 to the display unit 70, and the video is displayed on the head-up display as shown in FIGS.

  This is shown in FIG. FIG. 5 is a diagram illustrating an example of an image displayed on the head-up display. FIG. 5A is a diagram illustrating an image in front of the vehicle photographed by the infrared camera 10, and FIG. It is the figure which showed the image | video which surrounded the pedestrian who exists in an image | video with the frame.

  As shown in FIG. 5 (a), when a pedestrian 80 is present in an image captured by the infrared camera 10, a frame 90 surrounding the pedestrian 80 is included in the image as shown in FIG. 5 (b). Is displayed to alert the driver. At this time, the frame 90 is emphasized or monotonously displayed according to the alerting degree, that is, the advanced alerting or the low alerting. In addition, since the frame 90 shown in FIG. 5B is displayed only when the pedestrian 80 is captured in the image captured by the infrared camera 10, it can be dangerous for the driver. The driver can be alerted according to the situation of the driver and own vehicle.

  When no person is detected by pattern matching in the detection unit 20, the alerting unit 40 does not perform the alerting process, and the image captured by the infrared camera 10 is displayed on the head-up display of the display unit 50. Will be.

  As described above, in the present embodiment, the situation related to the own vehicle is detected, weight coefficients are assigned to the detection results, and weighting calculations are performed using these weight coefficients. Then, it is determined from the calculation result whether or not the presence of the object 80 should be notified. Thereby, according to the situation of the own vehicle or the driver, the presence of the object 80 in the video can be notified.

  Further, even if there are a plurality of objects 80 in the video, only the objects 80 that may be dangerous for the driver can be clearly displayed. Therefore, the driver can be alerted according to the situation. Furthermore, by not displaying the plurality of frames 90 in the video as described above, it is possible to display the scenery photographed by the infrared camera 10 without bothering the driver.

  In this embodiment, a plurality of stages of alerting processing are set according to the calculation result. Thereby, according to each step, processing for creating a warning image for informing the driver of the presence of the target object 80 more quickly and processing for generating a warning image for notifying the presence of the target object is performed. Can be alerted according to the situation.

(Other embodiments)
In the first embodiment, in the advanced alerting process, a process of changing the color of the entire video screen may be performed on the image for drawing the frame. Thereby, a driver can be made to recognize existence of a pedestrian more certainly. Further, the frame 90 continues to be displayed as long as the object continues to exist in the video, but may disappear when the frame 90 is displayed for a certain period of time.

  In the first embodiment, a head-up display is used as means for displaying an image. However, a monitor capable of displaying an image is mounted on the vehicle, and an image captured by the infrared camera 10 is displayed on the monitor. It doesn't matter.

  In the said 1st Embodiment, when performing an advanced alerting process in the alerting part 40, when displaying the frame 90, you may make it sound a buzzer. Further, when the frame 90 has not been displayed for a certain time or longer in the video, a buzzer may be sounded when the frame 90 is suddenly displayed to notify the driver of the display of the frame 90.

  The weight detection unit 30 shown in the first embodiment is an example. Therefore, means for detecting various situations can be added to the weight detection unit 30. Further, the user may be able to set items to be detected.

  Moreover, the value of the weight according to each situation shown in FIG. 4 shows an example, and can be set freely.

  In the first embodiment, there are three stages of alerting (high alerting, low alerting, and no alerting), but the alerting step is not limited to this. In addition, the driver may be able to freely change the number of stages. Further, a threshold value may be set, and a numerical value of a calculation result using the weighting coefficient may be compared with the threshold value to determine whether or not to call attention.

  In the first embodiment, the person has been described as an object that can be dangerous for the driver. However, the object may be other than a person such as a fallen object or a parked vehicle.

It is a block block diagram of the display apparatus for vehicles which concerns on one Embodiment of this invention. It is a schematic block diagram of a head-up display. It is a schematic diagram at the time of use of a head-up display. It is the figure which each showed the example which set the weight to each detection signal detected in the weight detection part, and the example of weighting. It is the figure which showed the example of the image | video displayed on a head up display, (a) is the figure which showed the image | video of the vehicle front image | photographed with the infrared camera, (b) exists in the image | video of (a). It is the figure which showed the image | video which enclosed the pedestrian with the frame.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Infrared camera, 20 ... Detection part, 30 ... Weight detection part, 40 ... Warning part,
50 ... display unit, 60 ... drawing unit, 70 ... indicator, 80 ... pedestrian, 90 ... frame.

Claims (3)

A camera (10) for photographing the front of the vehicle;
A detection unit (20) that detects an object (80) that may be dangerous for a driver from an image input from the camera, and that outputs at least coordinates and size data of the object;
A weight detector for detecting each of a plurality of state quantities represented by at least one of the information around the host vehicle, the host vehicle information, the driver information, and the object information as a weighting parameter. (30),
A weighting factor corresponding to the state quantity is set in advance, and from the relationship between the state quantity and the weighting factor, the weighting factor corresponding to each of a plurality of weighting parameters detected by the weight detection unit is used. When a weighting operation is performed on each object included in the image, and the numerical value of the operation result exceeds a threshold value, it is determined that the driver should be informed of the presence of the object, and the detection unit An alerting unit (40) for outputting image data of an alerting image (90) for explicitly displaying the object based on the coordinates and size of the object input from
A drawing unit (60) that superimposes the alert image on a position where the object is present on a video photographed by the camera and creates image data of the superimposed image. A display unit (50) for displaying the created image data ,
The weight detection unit includes a personal information input device that inputs the age of the driver,
The alerting unit is set with a weighting factor according to the age of the driver, and according to the age of the driver, which is personal information detected by the personal information input device during the weighting calculation. A vehicle display device characterized in that a weighting calculation is performed using a weighting coefficient, and whether or not the presence of the object should be notified is determined from the calculation result .   In the alerting unit, a plurality of stages of alerting processing are set according to the numerical value of the calculation result, and the presence of the target object from the calculation result in the alerting unit to the driver If it is determined that the alerting process should be notified, the alerting process at the stage corresponding to the numerical value of the calculation result is selected, and image data of the alerting image is created based on the alerting process. The vehicle display device according to claim 1, wherein the display device is a vehicle.   In the detection unit, a moving object is detected as the object, and in the alerting unit, a different weighting factor is set according to the moving direction of the moving object detected by the detection unit. The vehicle display device according to claim 1, wherein the display device is a vehicle display device.

Images