WO2017002195A1 - Vehicle-surroundings monitoring device and driving support system - Google Patents

Vehicle-surroundings monitoring device and driving support system Download PDF

Info

Publication number
WO2017002195A1
WO2017002195A1 PCT/JP2015/068818 JP2015068818W WO2017002195A1 WO 2017002195 A1 WO2017002195 A1 WO 2017002195A1 JP 2015068818 W JP2015068818 W JP 2015068818W WO 2017002195 A1 WO2017002195 A1 WO 2017002195A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
unit
display
monitoring device
periphery monitoring
Prior art date
Application number
PCT/JP2015/068818
Other languages
French (fr)
Japanese (ja)
Inventor
和裕 池田
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to JP2017525719A priority Critical patent/JP6342074B2/en
Priority to PCT/JP2015/068818 priority patent/WO2017002195A1/en
Publication of WO2017002195A1 publication Critical patent/WO2017002195A1/en

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems

Definitions

  • the present invention relates to a technique for monitoring the periphery of a vehicle, and more particularly to a technique for monitoring the movement of a rear vehicle approaching the vehicle from behind.
  • Patent Document 1 Japanese Patent Laid-Open No. 2008-9724
  • Patent Document 2 Japanese Patent Laid-Open No. 2003-306057
  • Patent Document 3 Japanese Patent Laid-Open No. 11-99879
  • imaging indicating a rear region of a vehicle is described.
  • a technique for displaying an image on a display of a navigation system or a display screen of an instrument panel is disclosed.
  • a captured image indicating a rear region of a vehicle is displayed on captured image display means such as a display constituting a navigation system.
  • a vehicle determination device that determines whether an emergency vehicle such as an ambulance appears in a captured image and issues a warning when the emergency vehicle exists is disclosed.
  • the driver cannot always take an appropriate action.
  • JP 2008-9724 A (for example, paragraphs 0021 and 0036) Japanese Patent Laid-Open No. 2003-306057 (for example, FIG. 1 and paragraph 0013) JP-A-11-99879 (for example, FIGS. 1 to 3 and paragraphs 0007, 0008, 0014)
  • an object of the present invention is to provide a vehicle periphery monitoring device and a driving support system that can perform driving support for the movement of a rear vehicle.
  • a vehicle periphery monitoring device includes an input unit that receives a captured image of a rear region from an imaging unit that captures a rear region of the vehicle, and vehicle information indicating movement of the rear vehicle that appears in the captured image. Based on the vehicle information generation unit to be generated and whether or not the rear vehicle corresponds to the vehicle of interest is determined based on the vehicle information, and an alarm notification signal is generated when it is determined that the vehicle behind the vehicle corresponds to the vehicle of interest And a display control unit that displays the captured image in parallel with the vehicle information on a display unit arranged in front of the driver's seat of the vehicle.
  • a driving support system is a driving support system including an imaging unit that images a rear region of a vehicle, a display unit disposed in front of a driver's seat of the vehicle, and a vehicle periphery monitoring device.
  • the vehicle periphery monitoring device includes an input unit that receives a captured image of the rear region from the imaging unit, a vehicle information generation unit that generates vehicle information indicating movement of a rear vehicle that appears in the captured image, A determination unit that determines whether or not the rear vehicle corresponds to a vehicle of interest based on the vehicle information, and generates and outputs a warning notification signal when it is determined that the rear vehicle corresponds to a vehicle of interest; And a display control unit configured to display the captured image in parallel with the vehicle information on the display unit.
  • the vehicle information indicating the movement of the rear vehicle and the captured image representing the rear vehicle are displayed in parallel on the display unit disposed in front of the driver's seat of the vehicle.
  • the vehicle information and the captured image are displayed on the display unit arranged at an easy position. Therefore, the driver can receive an alarm indicating that the rear vehicle corresponds to the vehicle of interest while recognizing the movement of the rear vehicle to some extent. Therefore, the driver can take an appropriate avoidance action with quick judgment according to the warning.
  • FIG. 3 is a diagram illustrating an arrangement example of a rear camera, a millimeter wave radar device, and a laser radar device in Embodiment 1.
  • FIG. It is a figure which shows the instrument panel of Embodiment 1.
  • FIG. It is a figure which shows schematically the structural example of the display screen of the instrument panel of Embodiment 1.
  • FIG. 3 is a flowchart schematically illustrating an example of a driving support process by a determination unit according to the first embodiment.
  • 3 is a flowchart schematically illustrating an example of a driving support process by a determination unit according to the first embodiment.
  • FIG. 1 is a functional block diagram showing a schematic configuration of a driving support system 1 according to the first embodiment of the present invention.
  • the driving support system 1 includes a rear camera 11, a millimeter wave radar device 12, and a laser radar device 13 in order to acquire information on the rear region of the vehicle.
  • FIG. 2 is a diagram illustrating an arrangement example of the rear camera 11, the millimeter wave radar device 12, and the laser radar device 13 in the vehicle 2 on which the driving support system 1 is mounted.
  • the rear camera 11 is a stereo camera having two image pickup devices, and has a left image pickup device 11L and a right image pickup device 11R respectively attached near both ends of the rear bumper 19 of the vehicle 2 as shown in FIG. .
  • the millimeter wave radar device 12 and the laser radar device 13 may be attached near the center of the rear bumper 19. The present invention is not limited to these attachment positions.
  • the rear camera 11 performs image processing on the image signals acquired by the left imaging element 11L and the right imaging element 11R, respectively, and a distance image that is stereoscopic image information of the rear region of the vehicle 2 and a two-dimensional image.
  • An intensity image that is information can be generated.
  • the distance image is an image expressing the distance between the subject and the vehicle 2 in units of pixels. Data indicating the distance image and the intensity image is supplied to the vehicle periphery monitoring device 10.
  • the millimeter wave radar device 12 is a sensor that detects the inter-vehicle distance and direction between the object and the vehicle 2 in the rear region of the vehicle 2. Data indicating the inter-vehicle distance detected by the millimeter wave radar device 12 is supplied to the vehicle periphery monitoring device 10. Further, the laser radar device 13 can scan the laser pulse light in the rear region of the vehicle 2 and generate a distance image and an intensity image based on the reflected light data. Data indicating the distance image and the intensity image is also supplied to the vehicle periphery monitoring device 10.
  • imaging unit of the present invention can be configured by either the rear camera 11 or the laser radar device 13.
  • the driving support system 1 includes a vehicle periphery monitoring device 10, a drawing circuit 14, a display unit 15, an audio circuit 16, and a speaker 17.
  • the vehicle periphery monitoring device 10 detects a rear vehicle that appears in the rear region of the vehicle 2, and the vehicle information indicating the movement of the rear vehicle and a captured image representing the rear vehicle are arranged in parallel on the display unit 15. Can be displayed. Further, as will be described later, the vehicle periphery monitoring device 10 has a function of outputting a warning notification signal to either the drawing circuit 14 or the audio circuit 16 when it is determined that the rear vehicle corresponds to the vehicle of interest. Have.
  • the vehicle of interest refers to a vehicle to be noted such as an emergency vehicle (for example, an ambulance) or a dangerous vehicle.
  • a dangerous vehicle for example, (a) a vehicle that compulsorily gives way to another vehicle that travels ahead, (b) a vehicle that approaches abnormally by reducing the inter-vehicle distance, (c) other vehicles (D) driving that threatens or harasses other vehicle occupants by, for example, high beam irradiation, passing (flashing headlights towards other vehicles), using horns or shifting the horn Vehicle on which a person gets on.
  • a vehicle in which a so-called “driving operation” is performed corresponds to a dangerous vehicle.
  • the audio circuit 16 and the speaker 17 can constitute the audio output unit of the present invention.
  • the display unit 15 can be configured by, for example, a liquid crystal display or an organic EL display.
  • the drawing circuit 14 receives the image signal output from the vehicle periphery monitoring device 10 and causes the display unit 15 to display an image based on the image signal.
  • the display unit 15 of the present embodiment includes an instrument panel 31 disposed in the vicinity of the operation handle 30 in front of the driver's seat of the vehicle 2, a front of the driver's seat, and an instrument. And a projection unit 39 for HUD (head-up display) disposed in front of the panel 31.
  • the drawing circuit 14 can display an image on one or both of the instrument panel 31 and the HUD projection unit 39.
  • the instrument panel 31 has a display screen facing the driver's seat.
  • the HUD projection unit 39 can display an image Pi by projecting an optical image onto the surface of the windshield 37 of the vehicle 2.
  • a head-up display device can be configured by the HUD projection unit 39 and the windshield 37, but the present invention is not limited to this.
  • a translucent sheet member instead of the windshield 37 may be used.
  • a half mirror called a combiner that displays an image of a front area of a vehicle and a projected image in an overlapping manner can be used.
  • the vehicle 2 also includes an in-vehicle navigation system having a navigation screen 38 shown in FIG.
  • FIG. 4 is a diagram schematically showing a configuration example of the display screen 31D of the instrument panel 31.
  • the display screen 31 ⁇ / b> D displays a traveling state display area 32 that displays a traveling state value of the vehicle 2 and an intensity image for rear monitoring (hereinafter referred to as “monitoring image”).
  • An image display area 34, a vehicle information display area 35 for displaying vehicle information to be described later, and a notification area 36 for displaying notification information by a notification signal to be described later are provided.
  • a tachometer 33A representing the engine speed of the vehicle 2
  • a vehicle speed meter 33B representing the speed of the vehicle 2
  • running state display area 32 running state values such as the remaining amount of fuel and the running distance may be displayed in addition to the engine speed and the vehicle speed.
  • the audio circuit 16 can receive the audio signal output from the vehicle periphery monitoring apparatus 10 and output the audio from the speaker 17 based on the audio signal.
  • the vehicle periphery monitoring device 10 includes an input circuit 21 as an input unit that receives outputs of the rear camera 11, the millimeter wave radar device 12, and the laser radar device 13, and a distance that represents a rear region of the vehicle 2.
  • a vehicle detection unit 22 that detects a rear vehicle appearing in the image
  • a distance measurement unit 23 that detects an inter-vehicle distance between the detected rear vehicle and the vehicle 2, and a behavior of the driver of the rear vehicle appearing in the monitoring image
  • a driver recognition unit 24 that automatically recognizes the vehicle
  • a vehicle information generation unit 25 that generates vehicle information indicating the movement of the rear vehicle in real time, and whether or not the rear vehicle corresponds to the vehicle of interest based on the vehicle information.
  • a determination unit 27 and a display control unit 26 that provides an image signal to the drawing circuit 14 to control the display content of the display unit 15 are provided.
  • the vehicle detection unit 22 acquires a distance image from the input circuit 21 and analyzes the distance image using a known image recognition technique such as pattern matching, thereby detecting a rear vehicle appearing in the distance image in real time. Can do.
  • the vehicle detection unit 22 normally detects the rear vehicle using the distance image generated by the rear camera 11.
  • the vehicle detection unit 22 uses the millimeter wave radar.
  • the rear vehicle can be detected using the detection output of the device 12 or the detection output of the laser radar device 13.
  • the vehicle detection unit 22 acquires a monitoring image from the input circuit 21 and outputs data indicating the monitoring image to the vehicle information generation unit 25.
  • the distance measuring unit 23 can detect the inter-vehicle distance between the rear vehicle and the vehicle 2 using the distance image acquired from the input circuit 21 based on the detection result by the vehicle detection unit 22. Data indicating the inter-vehicle distance is given to the determination unit 27 and the vehicle information generation unit 25.
  • the vehicle information generation unit 25 detects the relative speed of the rear vehicle with respect to the vehicle 2 and the relative acceleration of the rear vehicle with respect to the vehicle 2 based on the detection result of the vehicle detection unit 22 and the detected value of the inter-vehicle distance.
  • the vehicle information generation unit 25 outputs the distance information supplied from the distance measurement unit 23 together with the relative speed and the relative acceleration to the display control unit 26 as vehicle information.
  • the display control unit 26 can display the relative speed, the relative acceleration, and the inter-vehicle distance in the vehicle information display area 35 of the display screen 31D shown in FIG. As shown in FIG.
  • the value of the relative speed relating to the elapsed time up to the present in the vehicle information display area 35, the value of the relative speed relating to the elapsed time up to the present, the value of the relative acceleration relating to the elapsed time up to the present, and the value of the inter-vehicle distance relating to the elapsed time up to the present. And are displayed respectively.
  • the value of the relative speed is displayed as “speed”
  • the value of the relative acceleration is displayed as “acceleration”
  • the value of the inter-vehicle distance is displayed as “distance”.
  • the vehicle information generation unit 25 outputs data indicating the monitoring image input from the vehicle detection unit 22 to the display control unit 26.
  • the display control unit 26 generates an image signal based on the data input from the vehicle information generation unit 25 and supplies the image signal to the drawing circuit 14.
  • the drawing circuit 14 can display the monitoring image on one or both of the instrument panel 31 and the HUD projection unit 39.
  • the drawing circuit 14 can cause the HUD projection unit 39 to display an image having the same contents as the display screen 31D shown in FIG.
  • the driver recognition unit 24 can automatically recognize the behavior of the driver of the rear vehicle by analyzing the distance image acquired from the input circuit 21 based on the detection result by the vehicle detection unit 22. This type of automatic recognition can be realized by using, for example, a pattern recognition technique using a known neural network.
  • the driver recognition unit 24 can detect, for example, the line of sight of the driver of the rear vehicle and recognize whether the line of sight is stable.
  • the distance measuring unit 23 and driver recognition The unit 24 can use the distance image generated by the laser radar device 13.
  • the distance measuring unit 23 and the driver recognizing unit 24 use, for example, a distance image generated by the millimeter wave radar device 12 when the inter-vehicle distance is large, and the measurement accuracy of the inter-vehicle distance is small.
  • a distance image generated by the high laser radar device 13 can be used.
  • the determination part 27 can determine whether the said back vehicle is an attention vehicle based on the said vehicle information. If it is determined that the rear vehicle is the vehicle of interest, the determination unit 27 outputs a warning notification signal to the audio circuit 16 or the display control unit 26. When the notification signal is output to the audio circuit 16, the speaker 17 outputs an alarm sound toward the driver's seat. On the other hand, when the notification signal is output to the display control unit 26, a warning message is displayed in the notification area 36 of the display screen 31D shown in FIG.
  • FIGS. 5 and 6 are flowcharts schematically showing an example of the driving support process by the determination unit 27 of the first embodiment.
  • the flowchart shown in FIG. 5 and the flowchart shown in FIG. 6 are connected to each other via connectors C1 and C2.
  • This driving support process is executed during operation of the engine of the vehicle 2. Further, this driving support process may be performed not only when the vehicle 2 is in a traveling state but also when the vehicle 2 is in a stopped state.
  • the determination part 27 is standing by until the vehicle detection part 22 detects a back vehicle (NO of step ST10).
  • the determination unit 27 detects the state and acquires the current value of the relative speed from the vehicle information generation unit 25 (step ST11).
  • the determination unit 27 determines whether or not the relative speed is equal to or higher than a predetermined upper limit speed (step ST12).
  • the determination unit 27 acquires the current value of the inter-vehicle distance from the distance measurement unit 23 (step ST13). Then, when the inter-vehicle distance is within a predetermined proximity distance, the determination unit 27 determines that the rear vehicle corresponds to the vehicle of interest (YES in step ST14), and notifies the audio circuit 16 or the display control unit 26. A signal is output (step ST15). Then, the determination part 27 returns the procedure of a driving assistance process to step ST10.
  • the determination unit 27 determines that the rear vehicle does not correspond to the vehicle of interest (NO in step ST14), and the procedure of the driving support process is performed in step ST16. To migrate.
  • step ST16 is executed.
  • step ST ⁇ b> 16 the determination unit 27 acquires the current value of relative acceleration from the vehicle information generation unit 25.
  • the determination unit 27 determines whether or not the relative acceleration is greater than or equal to a predetermined upper limit acceleration (step ST17).
  • the determination unit 27 acquires the current value of the inter-vehicle distance from the distance measurement unit 23 (step ST18). Then, when the inter-vehicle distance is within a predetermined proximity distance, the determination unit 27 determines that the rear vehicle corresponds to the vehicle of interest (YES in step ST19), and notifies the audio circuit 16 or the display control unit 26. A signal is output (step ST20). Then, the determination part 27 returns the procedure of a driving assistance process to step ST10.
  • step ST19 when the inter-vehicle distance exceeds the predetermined proximity distance in step ST19, the determination unit 27 determines that the rear vehicle does not correspond to the vehicle of interest (NO in step ST19), and performs the driving support process. The procedure is shifted to step ST21 in FIG.
  • step ST21 the determination unit 27 monitors the behavior of the driver of the rear vehicle using the recognition result by the driver recognition unit 24.
  • the determination unit 27 acquires the current value of the inter-vehicle distance from the distance measurement unit 23 (step ST23). For example, when it is recognized that the driver's line of sight of the rear vehicle is not stable, or when it is recognized that the driver of the rear vehicle is operating the portable communication terminal, the rear vehicle is the vehicle of interest. Is likely. In such a case, the determination unit 27 can determine that the behavior of the driver matches the specific condition.
  • the determination unit 27 determines that the rear vehicle corresponds to the vehicle of interest (YES in step ST24), and notifies the audio circuit 16 or the display control unit 26. A signal is output (step ST25). Then, the determination part 27 returns the procedure of a driving assistance process to step ST10 of FIG.
  • step ST24 determines that the rear vehicle does not correspond to the vehicle of interest (NO in step ST24), and the procedure for the driving support process Is transferred to step ST26.
  • step ST22 when the driver's behavior does not match the specific condition (NO in step ST22), the determination unit 27 shifts the driving support process to step ST26.
  • step ST26 for example, when there is an end command, the driving support process ends (YES in step ST26).
  • the procedure of the driving support process returns to step ST10 in FIG.
  • FIG. 7 is a diagram showing an example of the display contents of the instrument panel 31 when a rear vehicle is detected. As shown in FIG. 7, a captured image of the detected rear vehicle is displayed in the image display area 34. The vehicle information display area 35 shows changes in relative speed, relative acceleration, and inter-vehicle distance.
  • FIG. 8 is a diagram illustrating an example of display contents of the instrument panel 31 when it is determined that the rear vehicle corresponds to the vehicle of interest after detection of the rear vehicle. As shown in FIG. 8, a warning message is displayed in the notification area 36.
  • All or part of the functions of the vehicle periphery monitoring device 10 described above can be realized by a computer program.
  • the function can be realized by a processor including a CPU (Central Processing Unit) loading and executing the computer program from a computer-readable recording medium.
  • CPU Central Processing Unit
  • FIG. 9 is a functional block diagram schematically showing an example of a hardware configuration of the vehicle periphery monitoring device 10M realized by a computer program.
  • 9 includes a determination circuit 41 that is a processor including a CPU 41C, a general-purpose processor 42 that includes a CPU 42C, a RAM (Random Access Memory) 43, and a nonvolatile memory such as a ROM (Read Only Memory). 44, a recording medium 45 such as a flash memory or an HDD (Hard Disk Drive), and an input / output interface 46.
  • a determination circuit 41 that is a processor including a CPU 41C, a general-purpose processor 42 that includes a CPU 42C, a RAM (Random Access Memory) 43, and a nonvolatile memory such as a ROM (Read Only Memory). 44, a recording medium 45 such as a flash memory or an HDD (Hard Disk Drive), and an input / output interface 46.
  • These components 41 to 46 are connected to each other via a bus 49.
  • the determination circuit 41 has the functions of the vehicle detection unit 22, the distance measurement unit 23, the driver recognition unit 24, the vehicle information generation unit 25, the display control unit 26, and the determination unit 27 described above.
  • the input / output interface 46 has the function of the input circuit 21 (FIG. 1).
  • the input / output interface 46 also functions as an interface to the drawing circuit 14 and the audio circuit 16 (FIG. 1).
  • the determination circuit 41 loads the driving support program that is a software program from the nonvolatile memory 44 or the recording medium 45 and operates according to the driving support program, thereby realizing the function of the vehicle periphery monitoring device 10 described above. Can do.
  • a part of the functions of the vehicle periphery monitoring device 10 may be realized by a general-purpose processor 42.
  • the vehicle information indicating the movement of the rear vehicle is displayed on the display unit 15 together with the monitoring image in real time.
  • a warning that the rear vehicle corresponds to the vehicle of interest is received. Therefore, compared to the case where the warning is received in the state where the movement of the rear vehicle is not recognized or the movement of the rear vehicle is vaguely recognized, the driver can take appropriate risk avoidance action with quick judgment. Can take. Accordingly, even when an unpredictable movement suddenly occurs in the rear adjacent vehicle, an appropriate driving operation for avoiding danger can be performed in response to this movement. For example, when a driver receives a warning sound or a warning message for a rear vehicle approaching rapidly on an expressway, the driver can quickly take a risk avoidance action such as a lane change. The driver can immediately respond to an emergency situation.
  • the embodiment according to the present invention has been described above with reference to the drawings. However, this embodiment is an exemplification of the present invention, and various forms other than this embodiment can be adopted.
  • the rear camera 11, the millimeter wave radar device 12, and the laser radar device 13 are used as the sensor group used for detecting the inter-vehicle distance.
  • the present invention is not limited to these. Absent.
  • a quasi-millimeter wave radar device, an ultrasonic sensor, or a microwave sensor can be used.
  • any component of the above embodiment can be modified, or any component of the above embodiment can be omitted.
  • the vehicle periphery monitoring device and the driving support system according to the present invention are suitable for use in an automobile traveling on a roadway, but are not limited thereto.
  • the present invention can be applied to a railway vehicle traveling on a rail.
  • SYMBOLS 1 Driving assistance system 2 vehicle, 10, 10M vehicle periphery monitoring apparatus, 11 rear camera, 11R right side image sensor, 11L left side image sensor, 12 millimeter wave radar apparatus, 13 laser radar apparatus, 14 drawing circuit, 15 display part, 16 Audio circuit, 17 speaker, 19 rear bumper, 21 input circuit, 22 vehicle detection unit, 23 ranging unit, 24 driver recognition unit, 25 vehicle information generation unit, 26 display control unit, 27 determination unit, 30 operation handle, 31 instrument Instrument panel, 31D display screen, 32 running state display area, 33A tachometer, 33B speedometer, 34 image display area, 35 vehicle information display area, 36 notification area, 41 determination circuit, 42 processor, 43 RAM, 44 nonvolatile memory, 45 recording media, 46 input / output Interface, 49 bus.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)

Abstract

A vehicle-surroundings monitoring device (10) includes: a vehicle-information generating unit (25) that generates vehicle information indicating movement of a vehicle behind that appears in a captured image; a determining unit (27) that determines whether the vehicle behind is a vehicle needing attention on the basis of the vehicle information; and a display control unit (26) that displays the captured image side by side with the vehicle information on a display unit (15) disposed in front of a driver's seat in the vehicle. The determining unit (27) generates and outputs an alert notification signal when the vehicle behind is determined as being a vehicle needing attention.

Description

車両周辺監視装置及び運転支援システムVehicle periphery monitoring device and driving support system
 本発明は、車両周辺を監視する技術に関し、特に、車両に後方から接近する後方車両の動きを監視する技術に関する。 The present invention relates to a technique for monitoring the periphery of a vehicle, and more particularly to a technique for monitoring the movement of a rear vehicle approaching the vehicle from behind.
 近年、運転者による運転操作の支援や安全の確保のために、車載カメラで得られた撮像画像を用いて車両の周辺を監視する技術が提供されている。たとえば、特許文献1(特開2008-9724号公報)、特許文献2(特開2003-306057号公報)及び特許文献3(特開平11-99879号公報)には、車両の後方領域を示す撮像画像をナビゲーションシステムのディスプレイや計器パネルの表示画面に表示させる技術が開示されている。 In recent years, in order to support driving operations by a driver and to ensure safety, a technique for monitoring the periphery of a vehicle using a captured image obtained by an in-vehicle camera has been provided. For example, in Patent Document 1 (Japanese Patent Laid-Open No. 2008-9724), Patent Document 2 (Japanese Patent Laid-Open No. 2003-306057), and Patent Document 3 (Japanese Patent Laid-Open No. 11-99879), imaging indicating a rear region of a vehicle is described. A technique for displaying an image on a display of a navigation system or a display screen of an instrument panel is disclosed.
 特許文献1の従来技術では、車両の後方領域を示す撮像画像は、ナビゲーションシステムを構成するディスプレイなどの撮像画像表示手段に表示される。また、撮像画像内に救急車などの緊急車両が現れたか否かを判定し、当該緊急車両が存在する場合に警告を発する車両判定装置が開示されている。しかしながら、運転者は、運転操作中に、その警告を突然受けても、必ずしも適切な対応をとることができるとは限らない。 In the prior art disclosed in Patent Document 1, a captured image indicating a rear region of a vehicle is displayed on captured image display means such as a display constituting a navigation system. In addition, a vehicle determination device that determines whether an emergency vehicle such as an ambulance appears in a captured image and issues a warning when the emergency vehicle exists is disclosed. However, even if the driver suddenly receives the warning during the driving operation, the driver cannot always take an appropriate action.
 一方、特許文献2の従来技術では、車両後方の状況を示す撮像画像が計器パネル内に表示される。これにより、当該撮像画像を視認するための視線移動量が少なくて済むので、運転者は、容易に自動車の後方の状況を確認することができる。同様に、特許文献3の従来技術では、メータ情報を表示できるメータクラスタ内にモニタ画面が設けられており、後方車両の接近時に、このモニタ画面に車両後方情報を示す撮像画像が表示される。 On the other hand, in the prior art of Patent Document 2, a captured image indicating the situation behind the vehicle is displayed in the instrument panel. Thereby, since the amount of line-of-sight movement for visually recognizing the captured image is small, the driver can easily confirm the situation behind the automobile. Similarly, in the prior art of Patent Document 3, a monitor screen is provided in a meter cluster that can display meter information, and when a rear vehicle approaches, a captured image indicating vehicle rear information is displayed on the monitor screen.
特開2008-9724号公報(たとえば、段落0021,0036)JP 2008-9724 A (for example, paragraphs 0021 and 0036) 特開2003-306057号公報(たとえば、図1及び段落0013)Japanese Patent Laid-Open No. 2003-306057 (for example, FIG. 1 and paragraph 0013) 特開平11-99879号公報(たとえば、図1~図3、及び段落0007,0008,0014)JP-A-11-99879 (for example, FIGS. 1 to 3 and paragraphs 0007, 0008, 0014)
 しかしながら、車両内の計器パネルやメータクラスタに車両後方領域の撮像画像が表示されたとしても、当該車両の運転者は、運転操作中に、その表示画像を常時確認することができるとは限らない。このため、後方車両の動きに対応して、素早く適切な運転操作を行うには限界がある。 However, even if a captured image of the vehicle rear region is displayed on the instrument panel or meter cluster in the vehicle, the driver of the vehicle may not always be able to confirm the display image during the driving operation. . For this reason, there is a limit in quickly performing an appropriate driving operation corresponding to the movement of the vehicle behind.
 上記に鑑みて本発明の目的は、後方車両の動きに対して運転支援を行うことができる車両周辺監視装置及び運転支援システムを提供する点にある。 In view of the above, an object of the present invention is to provide a vehicle periphery monitoring device and a driving support system that can perform driving support for the movement of a rear vehicle.
 本発明の一態様による車両周辺監視装置は、車両の後方領域を撮像する撮像部から当該後方領域の撮像画像が入力される入力部と、前記撮像画像に現れる後方車両の動きを示す車両情報を生成する車両情報生成部と、前記車両情報に基づいて前記後方車両が注目車両に該当するか否かを判定し、前記後方車両が注目車両に該当すると判定したときに警報用の通知信号を生成して出力する判定部と、当該車両の運転席の前方に配置された表示部に前記車両情報とともに前記撮像画像を並列表示させる表示制御部とを備えることを特徴とする。 A vehicle periphery monitoring device according to an aspect of the present invention includes an input unit that receives a captured image of a rear region from an imaging unit that captures a rear region of the vehicle, and vehicle information indicating movement of the rear vehicle that appears in the captured image. Based on the vehicle information generation unit to be generated and whether or not the rear vehicle corresponds to the vehicle of interest is determined based on the vehicle information, and an alarm notification signal is generated when it is determined that the vehicle behind the vehicle corresponds to the vehicle of interest And a display control unit that displays the captured image in parallel with the vehicle information on a display unit arranged in front of the driver's seat of the vehicle.
 本発明の他の態様による運転支援システムは、車両の後方領域を撮像する撮像部と、当該車両の運転席の前方に配置された表示部と、車両周辺監視装置とを備えた運転支援システムであって、前記車両周辺監視装置は、前記撮像部から当該後方領域の撮像画像が入力される入力部と、前記撮像画像に現れる後方車両の動きを示す車両情報を生成する車両情報生成部と、前記車両情報に基づいて前記後方車両が注目車両に該当するか否かを判定し、前記後方車両が注目車両に該当すると判定したときに警報用の通知信号を生成して出力する判定部と、前記表示部に前記車両情報とともに前記撮像画像を並列表示させる表示制御部とを備えることを特徴とする。 A driving support system according to another aspect of the present invention is a driving support system including an imaging unit that images a rear region of a vehicle, a display unit disposed in front of a driver's seat of the vehicle, and a vehicle periphery monitoring device. The vehicle periphery monitoring device includes an input unit that receives a captured image of the rear region from the imaging unit, a vehicle information generation unit that generates vehicle information indicating movement of a rear vehicle that appears in the captured image, A determination unit that determines whether or not the rear vehicle corresponds to a vehicle of interest based on the vehicle information, and generates and outputs a warning notification signal when it is determined that the rear vehicle corresponds to a vehicle of interest; And a display control unit configured to display the captured image in parallel with the vehicle information on the display unit.
 本発明によれば、車両の運転席の前方に配置された表示部に、後方車両の動きを示す車両情報と当該後方車両を表す撮像画像とが並列表示されるので、運転者が常時確認しやすい位置に配置された表示部に車両情報と撮像画像とが表示される。よって、運転者は、後方車両の動きをある程度認識している状態で、当該後方車両が注目車両に該当する旨の警報を受けることができる。したがって、運転者は、当該警報に応じて、素早い判断で適切な回避行動をとることができる。 According to the present invention, the vehicle information indicating the movement of the rear vehicle and the captured image representing the rear vehicle are displayed in parallel on the display unit disposed in front of the driver's seat of the vehicle. The vehicle information and the captured image are displayed on the display unit arranged at an easy position. Therefore, the driver can receive an alarm indicating that the rear vehicle corresponds to the vehicle of interest while recognizing the movement of the rear vehicle to some extent. Therefore, the driver can take an appropriate avoidance action with quick judgment according to the warning.
本発明に係る実施の形態1の運転支援システムの概略構成を示す機能ブロック図である。It is a functional block diagram which shows schematic structure of the driving assistance system of Embodiment 1 which concerns on this invention. 実施の形態1におけるリアカメラ、ミリ波レーダ装置及びレーザレーダ装置の配置例を示す図である。3 is a diagram illustrating an arrangement example of a rear camera, a millimeter wave radar device, and a laser radar device in Embodiment 1. FIG. 実施の形態1のインストルメントパネルを示す図である。It is a figure which shows the instrument panel of Embodiment 1. FIG. 実施の形態1のインストルメントパネルの表示画面の構成例を概略的に示す図である。It is a figure which shows schematically the structural example of the display screen of the instrument panel of Embodiment 1. FIG. 実施の形態1の判定部による運転支援処理の一例を概略的に示すフローチャートである。3 is a flowchart schematically illustrating an example of a driving support process by a determination unit according to the first embodiment. 実施の形態1の判定部による運転支援処理の一例を概略的に示すフローチャートである。3 is a flowchart schematically illustrating an example of a driving support process by a determination unit according to the first embodiment. 後方車両が検出されたときのインストルメントパネルの表示内容の一例を示す図である。It is a figure which shows an example of the display content of an instrument panel when a back vehicle is detected. 後方車両が注目車両に該当するときのインストルメントパネルの表示内容の一例を示す図である。It is a figure which shows an example of the display content of an instrument panel when a back vehicle corresponds to an attention vehicle. 車両周辺監視装置のハードウェア構成の一例を概略的に示す機能ブロック図である。It is a functional block diagram which shows roughly an example of the hardware constitutions of a vehicle periphery monitoring apparatus.
 以下、図面を参照しつつ、本発明に係る種々の実施の形態について詳細に説明する。なお、図面において同一符号を付された構成要素は、同一構成及び同一機能を有するものとする。 Hereinafter, various embodiments according to the present invention will be described in detail with reference to the drawings. In addition, the component which attached | subjected the same code | symbol in drawing shall have the same structure and the same function.
実施の形態1.
 図1は、本発明に係る実施の形態1の運転支援システム1の概略構成を示す機能ブロック図である。この運転支援システム1は、車両の後方領域の情報を取得するためにリアカメラ11、ミリ波レーダ装置12及びレーザレーダ装置13を備えている。図2は、運転支援システム1を搭載する車両2におけるリアカメラ11、ミリ波レーダ装置12及びレーザレーダ装置13の配置例を示す図である。リアカメラ11は、2台の撮像素子を有するステレオカメラであり、図2に示されるように、車両2のリアバンパ19の両端部付近にそれぞれ取り付けられた左側撮像素子11L及び右側撮像素子11Rを有する。また、ミリ波レーダ装置12及びレーザレーダ装置13は、リアバンパ19の中央部付近に取り付けられればよい。なお、本発明は、これら取り付け位置に限定されるものではない。
Embodiment 1 FIG.
FIG. 1 is a functional block diagram showing a schematic configuration of a driving support system 1 according to the first embodiment of the present invention. The driving support system 1 includes a rear camera 11, a millimeter wave radar device 12, and a laser radar device 13 in order to acquire information on the rear region of the vehicle. FIG. 2 is a diagram illustrating an arrangement example of the rear camera 11, the millimeter wave radar device 12, and the laser radar device 13 in the vehicle 2 on which the driving support system 1 is mounted. The rear camera 11 is a stereo camera having two image pickup devices, and has a left image pickup device 11L and a right image pickup device 11R respectively attached near both ends of the rear bumper 19 of the vehicle 2 as shown in FIG. . Further, the millimeter wave radar device 12 and the laser radar device 13 may be attached near the center of the rear bumper 19. The present invention is not limited to these attachment positions.
 リアカメラ11は、左側撮像素子11L及び右側撮像素子11Rでそれぞれ取得された画像信号に画像処理を施して、車両2の後方領域の立体的な画像情報である距離画像と、2次元的な画像情報である強度画像とを生成することができる。ここで、距離画像は、被写体と車両2との間の距離を画素単位で表現する画像である。距離画像及び強度画像を示すデータは、車両周辺監視装置10に供給される。 The rear camera 11 performs image processing on the image signals acquired by the left imaging element 11L and the right imaging element 11R, respectively, and a distance image that is stereoscopic image information of the rear region of the vehicle 2 and a two-dimensional image. An intensity image that is information can be generated. Here, the distance image is an image expressing the distance between the subject and the vehicle 2 in units of pixels. Data indicating the distance image and the intensity image is supplied to the vehicle periphery monitoring device 10.
 一方、ミリ波レーダ装置12は、車両2の後方領域における対象物と車両2との間の車間距離及び方向を検出するセンサである。ミリ波レーダ装置12で検出された車間距離を示すデータは、車両周辺監視装置10に供給される。また、レーザレーダ装置13は、車両2の後方領域にレーザパルス光を走査し、その反射光データに基づいて距離画像と強度画像とを生成することができる。これら距離画像及び強度画像を示すデータも、車両周辺監視装置10に供給される。 On the other hand, the millimeter wave radar device 12 is a sensor that detects the inter-vehicle distance and direction between the object and the vehicle 2 in the rear region of the vehicle 2. Data indicating the inter-vehicle distance detected by the millimeter wave radar device 12 is supplied to the vehicle periphery monitoring device 10. Further, the laser radar device 13 can scan the laser pulse light in the rear region of the vehicle 2 and generate a distance image and an intensity image based on the reflected light data. Data indicating the distance image and the intensity image is also supplied to the vehicle periphery monitoring device 10.
 なお、本発明の撮像部は、リアカメラ11またはレーザレーダ装置13のいずれかによって構成可能である。 Note that the imaging unit of the present invention can be configured by either the rear camera 11 or the laser radar device 13.
 図1に示されるように、運転支援システム1は、車両周辺監視装置10、描画回路14、表示部15、音声回路16及びスピーカ17を備えている。車両周辺監視装置10は、後述するように、車両2の後方領域に出現する後方車両を検出し、この後方車両の動きを示す車両情報と当該後方車両を表す撮像画像とを表示部15に並列表示させることができる。また、車両周辺監視装置10は、後述するように、後方車両が注目車両に該当すると判定したときは、警報用の通知信号を描画回路14または音声回路16のいずれか一方へ出力する機能をも有している。ここで、注目車両とは、緊急車両(たとえば、救急車)や危険車両などの注目すべき車両をいう。危険車両としては、たとえば、(a)前方を走行する他の車両に対して進路を譲ることを強要する車両、(b)車間距離を縮めて異常に接近してくる車両、(c)他の車両を追い回す車両、(d)たとえば、ハイビーム照射、パッシング(他の車両に向けてヘッドライトを点滅させること)、クラクションの使用または幅寄せによって、他の車両の乗員を威嚇しまたは嫌がらせを行う運転者が乗車する車両、が挙げられる。いわゆる「煽り運転」が行われる車両は、危険車両に該当する。なお、音声回路16及びスピーカ17によって本発明の音声出力部を構成することができる。 As shown in FIG. 1, the driving support system 1 includes a vehicle periphery monitoring device 10, a drawing circuit 14, a display unit 15, an audio circuit 16, and a speaker 17. As will be described later, the vehicle periphery monitoring device 10 detects a rear vehicle that appears in the rear region of the vehicle 2, and the vehicle information indicating the movement of the rear vehicle and a captured image representing the rear vehicle are arranged in parallel on the display unit 15. Can be displayed. Further, as will be described later, the vehicle periphery monitoring device 10 has a function of outputting a warning notification signal to either the drawing circuit 14 or the audio circuit 16 when it is determined that the rear vehicle corresponds to the vehicle of interest. Have. Here, the vehicle of interest refers to a vehicle to be noted such as an emergency vehicle (for example, an ambulance) or a dangerous vehicle. As a dangerous vehicle, for example, (a) a vehicle that compulsorily gives way to another vehicle that travels ahead, (b) a vehicle that approaches abnormally by reducing the inter-vehicle distance, (c) other vehicles (D) driving that threatens or harasses other vehicle occupants by, for example, high beam irradiation, passing (flashing headlights towards other vehicles), using horns or shifting the horn Vehicle on which a person gets on. A vehicle in which a so-called “driving operation” is performed corresponds to a dangerous vehicle. The audio circuit 16 and the speaker 17 can constitute the audio output unit of the present invention.
 表示部15は、たとえば、液晶ディスプレイまたは有機ELディスプレイで構成することができる。描画回路14は、車両周辺監視装置10から出力された画像信号を入力とし、この画像信号に基づいて表示部15に画像を表示させる。本実施の形態の表示部15は、図3に示されるように、車両2の運転席の真正面における操作ハンドル30の近傍に配置されたインストルメントパネル31と、当該運転席の真正面で且つインストルメントパネル31よりも前方に配置されたHUD(ヘッドアップディスプレイ)用投影ユニット39とを有する。描画回路14は、インストルメントパネル31及びHUD用投影ユニット39のうちの一方または双方に画像を表示させることが可能である。 The display unit 15 can be configured by, for example, a liquid crystal display or an organic EL display. The drawing circuit 14 receives the image signal output from the vehicle periphery monitoring device 10 and causes the display unit 15 to display an image based on the image signal. As shown in FIG. 3, the display unit 15 of the present embodiment includes an instrument panel 31 disposed in the vicinity of the operation handle 30 in front of the driver's seat of the vehicle 2, a front of the driver's seat, and an instrument. And a projection unit 39 for HUD (head-up display) disposed in front of the panel 31. The drawing circuit 14 can display an image on one or both of the instrument panel 31 and the HUD projection unit 39.
 インストルメントパネル31は、運転席の方向を向いた表示画面を有している。一方、HUD用投影ユニット39は、車両2のフロントガラス37の表面に光学像を投影して画像Piを表示することができる。本実施の形態では、HUD用投影ユニット39とフロントガラス37とでヘッドアップディスプレイ装置を構成することが可能であるが、これに限定されるものではない。画像投影面として、フロントガラス37の代わりの透光性シート部材が使用されてもよい。この種の透光性シート部材としては、たとえば、車両の前方領域の画像と投影画像とを重ねて表示するコンバイナと呼ばれるハーフミラーが使用可能である。なお、車両2は、図3に示されるナビゲーション画面38を有する車載ナビゲーションシステムも備えている。 The instrument panel 31 has a display screen facing the driver's seat. On the other hand, the HUD projection unit 39 can display an image Pi by projecting an optical image onto the surface of the windshield 37 of the vehicle 2. In the present embodiment, a head-up display device can be configured by the HUD projection unit 39 and the windshield 37, but the present invention is not limited to this. As the image projection surface, a translucent sheet member instead of the windshield 37 may be used. As this type of translucent sheet member, for example, a half mirror called a combiner that displays an image of a front area of a vehicle and a projected image in an overlapping manner can be used. The vehicle 2 also includes an in-vehicle navigation system having a navigation screen 38 shown in FIG.
 図4は、インストルメントパネル31の表示画面31Dの構成例を概略的に示す図である。図4に示されるように、表示画面31Dには、車両2の走行状態値を表示する走行状態表示領域32と、後方監視用の強度画像(以下「監視用画像」と呼ぶ。)を表示する画像表示領域34と、後述する車両情報を表示する車両情報表示領域35と、後述する通知信号による通知情報を表示する通知領域36とが設けられている。走行状態表示領域32には、車両2のエンジン回転速度を表すタコメータ33Aと、車両2の速度を表す車速計33Bとが表示される。なお、走行状態表示領域32には、エンジン回転速度及び車両速度以外にも、燃料の残量や走行距離などの走行状態値が表示されてよい。 FIG. 4 is a diagram schematically showing a configuration example of the display screen 31D of the instrument panel 31. As shown in FIG. 4, the display screen 31 </ b> D displays a traveling state display area 32 that displays a traveling state value of the vehicle 2 and an intensity image for rear monitoring (hereinafter referred to as “monitoring image”). An image display area 34, a vehicle information display area 35 for displaying vehicle information to be described later, and a notification area 36 for displaying notification information by a notification signal to be described later are provided. In the traveling state display area 32, a tachometer 33A representing the engine speed of the vehicle 2 and a vehicle speed meter 33B representing the speed of the vehicle 2 are displayed. In the running state display area 32, running state values such as the remaining amount of fuel and the running distance may be displayed in addition to the engine speed and the vehicle speed.
 一方、音声回路16は、車両周辺監視装置10から出力された音声信号を入力とし、この音声信号に基づいてスピーカ17から音声を出力させることができる。 On the other hand, the audio circuit 16 can receive the audio signal output from the vehicle periphery monitoring apparatus 10 and output the audio from the speaker 17 based on the audio signal.
 図1を参照すると、車両周辺監視装置10は、リアカメラ11,ミリ波レーダ装置12及びレーザレーダ装置13のそれぞれの出力を受け付ける入力部としての入力回路21と、車両2の後方領域を表す距離画像に現れる後方車両を検出する車両検出部22と、検出された後方車両と車両2との間の車間距離を検出する測距部23と、監視用画像中に現れる後方車両の運転者の挙動を自動認識する運転者認識部24と、後方車両の動きを示す車両情報をリアルタイムに生成する車両情報生成部25と、車両情報に基づいて後方車両が注目車両に該当するか否かを判定する判定部27と、描画回路14に画像信号を与えて表示部15の表示内容を制御する表示制御部26とを備えている。 Referring to FIG. 1, the vehicle periphery monitoring device 10 includes an input circuit 21 as an input unit that receives outputs of the rear camera 11, the millimeter wave radar device 12, and the laser radar device 13, and a distance that represents a rear region of the vehicle 2. A vehicle detection unit 22 that detects a rear vehicle appearing in the image, a distance measurement unit 23 that detects an inter-vehicle distance between the detected rear vehicle and the vehicle 2, and a behavior of the driver of the rear vehicle appearing in the monitoring image A driver recognition unit 24 that automatically recognizes the vehicle, a vehicle information generation unit 25 that generates vehicle information indicating the movement of the rear vehicle in real time, and whether or not the rear vehicle corresponds to the vehicle of interest based on the vehicle information. A determination unit 27 and a display control unit 26 that provides an image signal to the drawing circuit 14 to control the display content of the display unit 15 are provided.
 車両検出部22は、入力回路21から距離画像を取得し、公知のパターンマッチングなどの画像認識技術を用いて距離画像を解析することにより、当該距離画像中に現れる後方車両をリアルタイムに検出することができる。ここで、車両検出部22は、通常は、リアカメラ11により生成された距離画像を用いて後方車両を検出する。ただし、視界不良等の要因により、リアカメラ11により生成された距離画像の画質が低い場合には(たとえば、S/N比が許容値を下回るときは)、車両検出部22は、ミリ波レーダ装置12の検出出力またはレーザレーダ装置13の検出出力を用いて、後方車両を検出することができる。また、車両検出部22は、入力回路21から監視用画像を取得し、この監視用画像を示すデータを車両情報生成部25に出力する。 The vehicle detection unit 22 acquires a distance image from the input circuit 21 and analyzes the distance image using a known image recognition technique such as pattern matching, thereby detecting a rear vehicle appearing in the distance image in real time. Can do. Here, the vehicle detection unit 22 normally detects the rear vehicle using the distance image generated by the rear camera 11. However, when the image quality of the distance image generated by the rear camera 11 is low due to factors such as poor visibility (for example, when the S / N ratio is less than the allowable value), the vehicle detection unit 22 uses the millimeter wave radar. The rear vehicle can be detected using the detection output of the device 12 or the detection output of the laser radar device 13. The vehicle detection unit 22 acquires a monitoring image from the input circuit 21 and outputs data indicating the monitoring image to the vehicle information generation unit 25.
 測距部23は、車両検出部22による検出結果に基づき、入力回路21から取得した距離画像を用いて当該後方車両と車両2との間の車間距離を検出することが可能である。当該車間距離を示すデータは、判定部27と車両情報生成部25とに与えられる。 The distance measuring unit 23 can detect the inter-vehicle distance between the rear vehicle and the vehicle 2 using the distance image acquired from the input circuit 21 based on the detection result by the vehicle detection unit 22. Data indicating the inter-vehicle distance is given to the determination unit 27 and the vehicle information generation unit 25.
 一方、車両情報生成部25は、車両検出部22による検出結果及び車間距離の検出値に基づき、車両2に対する当該後方車両の相対速度と、車両2に対する当該後方車両の相対加速度とを検出する。車両情報生成部25は、相対速度及び相対加速度とともに、測距部23から供給された距離情報を車両情報として表示制御部26に出力する。表示制御部26は、相対速度、相対加速度及び車間距離を、図4に示される表示画面31Dの車両情報表示領域35に表示させることができる。図4に示されるように、車両情報表示領域35には、現在までの経過時間に関する相対速度の値と、現在までの経過時間に関する相対加速度の値と、現在までの経過時間に関する車間距離の値とがそれぞれ表示されている。なお、図4では、相対速度の値は「速度」として、相対加速度の値は「加速度」として、車間距離の値は「距離」としてそれぞれ表示されている。 On the other hand, the vehicle information generation unit 25 detects the relative speed of the rear vehicle with respect to the vehicle 2 and the relative acceleration of the rear vehicle with respect to the vehicle 2 based on the detection result of the vehicle detection unit 22 and the detected value of the inter-vehicle distance. The vehicle information generation unit 25 outputs the distance information supplied from the distance measurement unit 23 together with the relative speed and the relative acceleration to the display control unit 26 as vehicle information. The display control unit 26 can display the relative speed, the relative acceleration, and the inter-vehicle distance in the vehicle information display area 35 of the display screen 31D shown in FIG. As shown in FIG. 4, in the vehicle information display area 35, the value of the relative speed relating to the elapsed time up to the present, the value of the relative acceleration relating to the elapsed time up to the present, and the value of the inter-vehicle distance relating to the elapsed time up to the present. And are displayed respectively. In FIG. 4, the value of the relative speed is displayed as “speed”, the value of the relative acceleration is displayed as “acceleration”, and the value of the inter-vehicle distance is displayed as “distance”.
 更に、車両情報生成部25は、車両検出部22から入力された監視用画像を示すデータを表示制御部26に出力する。表示制御部26は、車両情報生成部25から入力された当該データに基づいて画像信号を生成し、この画像信号を描画回路14に供給する。これにより、描画回路14は、インストルメントパネル31及びHUD用投影ユニット39のうちの一方または双方に監視用画像を表示させることができる。描画回路14は、図4に示した表示画面31Dと同一内容の画像をHUD用投影ユニット39に表示させることが可能である。 Further, the vehicle information generation unit 25 outputs data indicating the monitoring image input from the vehicle detection unit 22 to the display control unit 26. The display control unit 26 generates an image signal based on the data input from the vehicle information generation unit 25 and supplies the image signal to the drawing circuit 14. Thereby, the drawing circuit 14 can display the monitoring image on one or both of the instrument panel 31 and the HUD projection unit 39. The drawing circuit 14 can cause the HUD projection unit 39 to display an image having the same contents as the display screen 31D shown in FIG.
 運転者認識部24は、車両検出部22による検出結果に基づき、入力回路21から取得した距離画像を解析して当該後方車両の運転者の挙動を自動認識することができる。この種の自動認識は、たとえば、公知のニューラルネットによるパターン認識技術を用いて実現可能である。運転者認識部24は、たとえば、当該後方車両の運転者の視線を検出し、当該視線が安定しているか否かを認識することができる。 The driver recognition unit 24 can automatically recognize the behavior of the driver of the rear vehicle by analyzing the distance image acquired from the input circuit 21 based on the detection result by the vehicle detection unit 22. This type of automatic recognition can be realized by using, for example, a pattern recognition technique using a known neural network. The driver recognition unit 24 can detect, for example, the line of sight of the driver of the rear vehicle and recognize whether the line of sight is stable.
 なお、視界不良等の要因により、リアカメラ11により生成された距離画像の画質が低い場合には(たとえば、S/N比が許容値を下回る場合には)、測距部23及び運転者認識部24は、レーザレーダ装置13により生成された距離画像を使用することができる。また、測距部23及び運転者認識部24は、たとえば、車間距離が大きい場合には、ミリ波レーダ装置12により生成された距離画像を使用し、車間距離が小さい場合には、測定精度の高いレーザレーダ装置13により生成された距離画像を使用することができる。 When the image quality of the distance image generated by the rear camera 11 is low (for example, when the S / N ratio is lower than the allowable value) due to factors such as poor visibility, the distance measuring unit 23 and driver recognition The unit 24 can use the distance image generated by the laser radar device 13. The distance measuring unit 23 and the driver recognizing unit 24 use, for example, a distance image generated by the millimeter wave radar device 12 when the inter-vehicle distance is large, and the measurement accuracy of the inter-vehicle distance is small. A distance image generated by the high laser radar device 13 can be used.
 そして、判定部27は、上記車両情報に基づき、当該後方車両が注目車両であるか否かを判定することができる。当該後方車両が注目車両であると判定した場合には、判定部27は、音声回路16または表示制御部26に警報用の通知信号を出力する。通知信号が音声回路16に出力されたとき、スピーカ17は、警報音を運転席に向けて出力する。一方、通知信号が表示制御部26に出力されたときは、図4に示される表示画面31Dの通知領域36に警告メッセージが表示されることとなる。 And the determination part 27 can determine whether the said back vehicle is an attention vehicle based on the said vehicle information. If it is determined that the rear vehicle is the vehicle of interest, the determination unit 27 outputs a warning notification signal to the audio circuit 16 or the display control unit 26. When the notification signal is output to the audio circuit 16, the speaker 17 outputs an alarm sound toward the driver's seat. On the other hand, when the notification signal is output to the display control unit 26, a warning message is displayed in the notification area 36 of the display screen 31D shown in FIG.
 次に、図5及び図6を参照しつつ、上記車両周辺監視装置10の動作について説明する。図5及び図6は、実施の形態1の判定部27による運転支援処理の一例を概略的に示すフローチャートである。図5に示されるフローチャートと、図6に示されるフローチャートとは、結合子C1,C2を介して相互に接続されている。なお、この運転支援処理は、車両2のエンジンの動作中に実行される。また、この運転支援処理は、車両2の走行状態時だけでなく、車両2の停止状態時に行われてもよい。 Next, the operation of the vehicle periphery monitoring device 10 will be described with reference to FIGS. 5 and 6 are flowcharts schematically showing an example of the driving support process by the determination unit 27 of the first embodiment. The flowchart shown in FIG. 5 and the flowchart shown in FIG. 6 are connected to each other via connectors C1 and C2. This driving support process is executed during operation of the engine of the vehicle 2. Further, this driving support process may be performed not only when the vehicle 2 is in a traveling state but also when the vehicle 2 is in a stopped state.
 図5に示されるように、判定部27は、車両検出部22が後方車両を検出するまで待機している(ステップST10のNO)。車両検出部22が後方車両を検出したとき(ステップST10のYES)、判定部27は、その状態を検知して、車両情報生成部25から相対速度の現在値を取得する(ステップST11)。次いで、判定部27は、相対速度が所定の上限速度以上であるか否かを判定する(ステップST12)。 As FIG. 5 shows, the determination part 27 is standing by until the vehicle detection part 22 detects a back vehicle (NO of step ST10). When the vehicle detection unit 22 detects a rear vehicle (YES in step ST10), the determination unit 27 detects the state and acquires the current value of the relative speed from the vehicle information generation unit 25 (step ST11). Next, the determination unit 27 determines whether or not the relative speed is equal to or higher than a predetermined upper limit speed (step ST12).
 当該相対速度が上限速度以上である場合には(ステップST12のYES)、判定部27は、測距部23から車間距離の現在値を取得する(ステップST13)。そして、判定部27は、当該車間距離が所定の近接距離以内である場合には、当該後方車両は注目車両に該当すると判定し(ステップST14のYES)、音声回路16または表示制御部26に通知信号を出力する(ステップST15)。その後、判定部27は、運転支援処理の手順をステップST10に戻す。 If the relative speed is equal to or higher than the upper limit speed (YES in step ST12), the determination unit 27 acquires the current value of the inter-vehicle distance from the distance measurement unit 23 (step ST13). Then, when the inter-vehicle distance is within a predetermined proximity distance, the determination unit 27 determines that the rear vehicle corresponds to the vehicle of interest (YES in step ST14), and notifies the audio circuit 16 or the display control unit 26. A signal is output (step ST15). Then, the determination part 27 returns the procedure of a driving assistance process to step ST10.
 一方、当該車間距離が所定の近接距離を超えている場合には、判定部27は、当該後方車両は注目車両に該当しないと判定し(ステップST14のNO)、運転支援処理の手順をステップST16に移行させる。 On the other hand, when the inter-vehicle distance exceeds the predetermined proximity distance, the determination unit 27 determines that the rear vehicle does not correspond to the vehicle of interest (NO in step ST14), and the procedure of the driving support process is performed in step ST16. To migrate.
 上記ステップST12で相対速度が上限速度未満であると判定された場合(ステップST12のNO)、ステップST16が実行される。ステップST16では、判定部27は、車両情報生成部25から相対加速度の現在値を取得する。次いで、判定部27は、相対加速度が所定の上限加速度以上であるか否かを判定する(ステップST17)。 If it is determined in step ST12 that the relative speed is less than the upper limit speed (NO in step ST12), step ST16 is executed. In step ST <b> 16, the determination unit 27 acquires the current value of relative acceleration from the vehicle information generation unit 25. Next, the determination unit 27 determines whether or not the relative acceleration is greater than or equal to a predetermined upper limit acceleration (step ST17).
 相対加速度が上限加速度以上である場合には(ステップST17のYES)、判定部27は、測距部23から車間距離の現在値を取得する(ステップST18)。そして、判定部27は、当該車間距離が所定の近接距離以内である場合には、当該後方車両は注目車両に該当すると判定し(ステップST19のYES)、音声回路16または表示制御部26に通知信号を出力する(ステップST20)。その後、判定部27は、運転支援処理の手順をステップST10に戻す。 When the relative acceleration is equal to or greater than the upper limit acceleration (YES in step ST17), the determination unit 27 acquires the current value of the inter-vehicle distance from the distance measurement unit 23 (step ST18). Then, when the inter-vehicle distance is within a predetermined proximity distance, the determination unit 27 determines that the rear vehicle corresponds to the vehicle of interest (YES in step ST19), and notifies the audio circuit 16 or the display control unit 26. A signal is output (step ST20). Then, the determination part 27 returns the procedure of a driving assistance process to step ST10.
 一方、ステップST19において、当該車間距離が所定の近接距離を超えている場合には、判定部27は、当該後方車両は注目車両に該当しないと判定し(ステップST19のNO)、運転支援処理の手順を図6のステップST21に移行させる。 On the other hand, when the inter-vehicle distance exceeds the predetermined proximity distance in step ST19, the determination unit 27 determines that the rear vehicle does not correspond to the vehicle of interest (NO in step ST19), and performs the driving support process. The procedure is shifted to step ST21 in FIG.
 ステップST21では、判定部27は、運転者認識部24による認識結果を用いて、後方車両の運転者の挙動を監視する。運転者の挙動が予め定められた特定条件に合致するとき(ステップST22のYES)、判定部27は、測距部23から車間距離の現在値を取得する(ステップST23)。たとえば、後方車両の運転者の視線が安定しないと認識された場合、または、後方車両の運転者が携帯型通信端末の操作を行っていると認識された場合には、当該後方車両は注目車両である可能性が高い。かかる場合に、判定部27は、運転者の挙動が特定条件に合致したと判定することができる。その後、当該車間距離が所定の近接距離以内である場合には、判定部27は、当該後方車両は注目車両に該当すると判定し(ステップST24のYES)、音声回路16または表示制御部26に通知信号を出力する(ステップST25)。その後、判定部27は、運転支援処理の手順を図5のステップST10に戻す。 In step ST21, the determination unit 27 monitors the behavior of the driver of the rear vehicle using the recognition result by the driver recognition unit 24. When the behavior of the driver matches a predetermined specific condition (YES in step ST22), the determination unit 27 acquires the current value of the inter-vehicle distance from the distance measurement unit 23 (step ST23). For example, when it is recognized that the driver's line of sight of the rear vehicle is not stable, or when it is recognized that the driver of the rear vehicle is operating the portable communication terminal, the rear vehicle is the vehicle of interest. Is likely. In such a case, the determination unit 27 can determine that the behavior of the driver matches the specific condition. Thereafter, when the inter-vehicle distance is within a predetermined proximity distance, the determination unit 27 determines that the rear vehicle corresponds to the vehicle of interest (YES in step ST24), and notifies the audio circuit 16 or the display control unit 26. A signal is output (step ST25). Then, the determination part 27 returns the procedure of a driving assistance process to step ST10 of FIG.
 一方、ステップST24において、当該車間距離が所定の近接距離を超えている場合に、判定部27は、当該後方車両は注目車両に該当しないと判定し(ステップST24のNO)、運転支援処理の手順をステップST26に移行させる。 On the other hand, if the inter-vehicle distance exceeds a predetermined proximity distance in step ST24, the determination unit 27 determines that the rear vehicle does not correspond to the vehicle of interest (NO in step ST24), and the procedure for the driving support process Is transferred to step ST26.
 上記ステップST22において、運転者の挙動が特定条件に合致しないときは(ステップST22のNO)、判定部27は、運転支援処理をステップST26に移行させる。ステップST26において、たとえば、終了指令があったとき、運転支援処理は終了する(ステップST26のYES)。一方、運転支援処理が終了しないときは(ステップST26のNO)、運転支援処理の手順は、図5のステップST10に戻る。 In step ST22, when the driver's behavior does not match the specific condition (NO in step ST22), the determination unit 27 shifts the driving support process to step ST26. In step ST26, for example, when there is an end command, the driving support process ends (YES in step ST26). On the other hand, when the driving support process does not end (NO in step ST26), the procedure of the driving support process returns to step ST10 in FIG.
 図7は、後方車両が検出されたときのインストルメントパネル31の表示内容の一例を示す図である。図7に示されるように、画像表示領域34には、検出された後方車両の撮像画像が表示されている。また、車両情報表示領域35には、相対速度、相対加速度及び車間距離の推移が示されている。図8は、後方車両の検出後、この後方車両が注目車両に該当すると判定されたときのインストルメントパネル31の表示内容の一例を示す図である。図8に示されるように、通知領域36に警告メッセージが表示されている。 FIG. 7 is a diagram showing an example of the display contents of the instrument panel 31 when a rear vehicle is detected. As shown in FIG. 7, a captured image of the detected rear vehicle is displayed in the image display area 34. The vehicle information display area 35 shows changes in relative speed, relative acceleration, and inter-vehicle distance. FIG. 8 is a diagram illustrating an example of display contents of the instrument panel 31 when it is determined that the rear vehicle corresponds to the vehicle of interest after detection of the rear vehicle. As shown in FIG. 8, a warning message is displayed in the notification area 36.
 上記した車両周辺監視装置10の機能の全部または一部は、コンピュータプログラムで実現することができる。この場合、CPU(Central Processing Unit)を含むプロセッサが、コンピュータ読み取り可能な記録媒体から当該コンピュータプログラムをロードし実行することによって当該機能を実現することができる。 All or part of the functions of the vehicle periphery monitoring device 10 described above can be realized by a computer program. In this case, the function can be realized by a processor including a CPU (Central Processing Unit) loading and executing the computer program from a computer-readable recording medium.
 図9は、コンピュータプログラムで実現される車両周辺監視装置10Mのハードウェア構成の一例を概略的に示す機能ブロック図である。図9の車両周辺監視装置10Mは、CPU41Cを含むプロセッサである判定回路41と、CPU42Cを含む汎用のプロセッサ42と、RAM(Random Access Memory)43と、ROM(Read Only Memory)などの不揮発性メモリ44と、フラッシュメモリやHDD(Hard Disk Drive)などの記録媒体45と、入出力インタフェース46とを備えている。これら構成要素41~46は、バス49を介して相互に接続されている。判定回路41は、上記した車両検出部22、測距部23、運転者認識部24、車両情報生成部25、表示制御部26及び判定部27の機能を有している。一方、入出力インタフェース46は、入力回路21(図1)の機能を有する。また、入出力インタフェース46は、描画回路14及び音声回路16(図1)に対するインタフェースとしても機能する。 FIG. 9 is a functional block diagram schematically showing an example of a hardware configuration of the vehicle periphery monitoring device 10M realized by a computer program. 9 includes a determination circuit 41 that is a processor including a CPU 41C, a general-purpose processor 42 that includes a CPU 42C, a RAM (Random Access Memory) 43, and a nonvolatile memory such as a ROM (Read Only Memory). 44, a recording medium 45 such as a flash memory or an HDD (Hard Disk Drive), and an input / output interface 46. These components 41 to 46 are connected to each other via a bus 49. The determination circuit 41 has the functions of the vehicle detection unit 22, the distance measurement unit 23, the driver recognition unit 24, the vehicle information generation unit 25, the display control unit 26, and the determination unit 27 described above. On the other hand, the input / output interface 46 has the function of the input circuit 21 (FIG. 1). The input / output interface 46 also functions as an interface to the drawing circuit 14 and the audio circuit 16 (FIG. 1).
 判定回路41は、不揮発性メモリ44または記録媒体45から、ソフトウェア・プログラムである運転支援プログラムをロードし、この運転支援プログラムに従って動作することにより、上記した車両周辺監視装置10の機能を実現することができる。なお、車両周辺監視装置10の機能の一部を汎用のプロセッサ42により実現してもよい。 The determination circuit 41 loads the driving support program that is a software program from the nonvolatile memory 44 or the recording medium 45 and operates according to the driving support program, thereby realizing the function of the vehicle periphery monitoring device 10 described above. Can do. A part of the functions of the vehicle periphery monitoring device 10 may be realized by a general-purpose processor 42.
 以上に説明したように実施の形態1の運転支援システム1では、表示部15には、後方車両の動きを示す車両情報が監視用画像とともにリアルタイムに表示されるので、運転者は、当該後方車両の動きをある程度認識している状態で、当該後方車両が注目車両に該当する旨の警報を受けることとなる。したがって、後方車両の動きを認識していない状態で、もしくは後方車両の動きを曖昧に認識している状態で警報を受けた場合と比べて、運転者は、素早い判断で適切な危険回避行動をとることができる。よって、後方の近接車両に予測不能な動きが突発したときでも、この動きに即応して、危険回避のための適切な運転操作を行うことができる。たとえば、高速道路上で急接近してくる後方車両について、運転者は、警報音または警告メッセージを受けると、素早く車線変更などの危険回避行動をとることができる。運転者は、緊急性の高い事態に対して即応することが可能である。 As described above, in the driving support system 1 of the first embodiment, the vehicle information indicating the movement of the rear vehicle is displayed on the display unit 15 together with the monitoring image in real time. In a state where the movement of the vehicle is recognized to some extent, a warning that the rear vehicle corresponds to the vehicle of interest is received. Therefore, compared to the case where the warning is received in the state where the movement of the rear vehicle is not recognized or the movement of the rear vehicle is vaguely recognized, the driver can take appropriate risk avoidance action with quick judgment. Can take. Accordingly, even when an unpredictable movement suddenly occurs in the rear adjacent vehicle, an appropriate driving operation for avoiding danger can be performed in response to this movement. For example, when a driver receives a warning sound or a warning message for a rear vehicle approaching rapidly on an expressway, the driver can quickly take a risk avoidance action such as a lane change. The driver can immediately respond to an emergency situation.
 以上、図面を参照して本発明に係る実施の形態について述べたが、この実施の形態は本発明の例示であり、この実施の形態以外の様々な形態を採用することもできる。たとえば、上記実施の形態では、車間距離の検出のために使用されるセンサ群として、リアカメラ11、ミリ波レーダ装置12及びレーザレーダ装置13が使用されているが、これらに限定されるものではない。たとえば、準ミリ波レーダ装置、超音波センサまたはマイクロ波センサを使用することも可能である。 The embodiment according to the present invention has been described above with reference to the drawings. However, this embodiment is an exemplification of the present invention, and various forms other than this embodiment can be adopted. For example, in the above embodiment, the rear camera 11, the millimeter wave radar device 12, and the laser radar device 13 are used as the sensor group used for detecting the inter-vehicle distance. However, the present invention is not limited to these. Absent. For example, a quasi-millimeter wave radar device, an ultrasonic sensor, or a microwave sensor can be used.
 なお、本発明の範囲内において、上記実施の形態の任意の構成要素の変形、または上記実施の形態の任意の構成要素の省略が可能である。 It should be noted that, within the scope of the present invention, any component of the above embodiment can be modified, or any component of the above embodiment can be omitted.
 本発明に係る車両周辺監視装置及び運転支援システムは、車道を走行する自動車に用いるのに適しているが、これに限定されるものではない。たとえば、レール上を走行する鉄道車両に本発明を適用することが可能である。 The vehicle periphery monitoring device and the driving support system according to the present invention are suitable for use in an automobile traveling on a roadway, but are not limited thereto. For example, the present invention can be applied to a railway vehicle traveling on a rail.
 1 運転支援システム、2 車両、10,10M 車両周辺監視装置、11 リアカメラ、11R 右側撮像素子、11L 左側撮像素子、12 ミリ波レーダ装置、13 レーザレーダ装置、14 描画回路、15 表示部、16 音声回路、17 スピーカ、19 リアバンパ、21 入力回路、22 車両検出部、23 測距部、24 運転者認識部、25 車両情報生成部、26 表示制御部、27 判定部、30 操作ハンドル、31 インストルメントパネル、31D 表示画面、32 走行状態表示領域、33A タコメータ、33B 車速計、34 画像表示領域、35 車両情報表示領域、36 通知領域、41 判定回路、42 プロセッサ、43 RAM、44 不揮発性メモリ、45 記録媒体、46 入出力インタフェース、49 バス。 DESCRIPTION OF SYMBOLS 1 Driving assistance system, 2 vehicle, 10, 10M vehicle periphery monitoring apparatus, 11 rear camera, 11R right side image sensor, 11L left side image sensor, 12 millimeter wave radar apparatus, 13 laser radar apparatus, 14 drawing circuit, 15 display part, 16 Audio circuit, 17 speaker, 19 rear bumper, 21 input circuit, 22 vehicle detection unit, 23 ranging unit, 24 driver recognition unit, 25 vehicle information generation unit, 26 display control unit, 27 determination unit, 30 operation handle, 31 instrument Instrument panel, 31D display screen, 32 running state display area, 33A tachometer, 33B speedometer, 34 image display area, 35 vehicle information display area, 36 notification area, 41 determination circuit, 42 processor, 43 RAM, 44 nonvolatile memory, 45 recording media, 46 input / output Interface, 49 bus.

Claims (13)

  1.  車両の後方領域を撮像する撮像部から当該後方領域の撮像画像が入力される入力部と、
     前記撮像画像に現れる後方車両の動きを示す車両情報を生成する車両情報生成部と、
     前記車両情報に基づいて前記後方車両が注目車両に該当するか否かを判定し、前記後方車両が注目車両に該当すると判定したときに警報用の通知信号を生成して出力する判定部と、
     当該車両の運転席の前方に配置された表示部に前記車両情報とともに前記撮像画像を並列表示させる表示制御部と
    を備えることを特徴とする車両周辺監視装置。
    An input unit that receives a captured image of the rear region from an imaging unit that captures the rear region of the vehicle;
    A vehicle information generation unit that generates vehicle information indicating the movement of the rear vehicle appearing in the captured image;
    A determination unit that determines whether or not the rear vehicle corresponds to a vehicle of interest based on the vehicle information, and generates and outputs a warning notification signal when it is determined that the rear vehicle corresponds to a vehicle of interest;
    A vehicle periphery monitoring device comprising: a display control unit configured to display the captured image in parallel with the vehicle information on a display unit disposed in front of a driver seat of the vehicle.
  2.  請求項1記載の車両周辺監視装置であって、
     前記表示部は、当該車両の運転席の真正面に配置されたインストルメントパネルを含み、
     前記インストルメントパネルの表示画面は、前記車両の走行状態値を示す走行状態表示領域、前記撮像画像を表示する画像表示領域、及び、前記車両情報を表示する車両情報表示領域を有する、
    ことを特徴とする車両周辺監視装置。
    The vehicle periphery monitoring device according to claim 1,
    The display unit includes an instrument panel disposed in front of the driver's seat of the vehicle,
    The display screen of the instrument panel has a running state display area indicating a running state value of the vehicle, an image display area for displaying the captured image, and a vehicle information display area for displaying the vehicle information.
    The vehicle periphery monitoring apparatus characterized by the above-mentioned.
  3.  請求項2記載の車両周辺監視装置であって、前記インストルメントパネルの表示画面は、更に、前記通知信号で示される警報情報を表示する通知領域を有することを特徴とする車両周辺監視装置。 3. The vehicle periphery monitoring device according to claim 2, wherein the display screen of the instrument panel further includes a notification area for displaying alarm information indicated by the notification signal.
  4.  請求項1記載の車両周辺監視装置であって、前記表示部は、当該車両の運転席の真正面に配置された画像投影面に光学像を投影して前記車両情報及び前記撮像画像を表示するヘッドアップディスプレイ装置を含むことを特徴とする車両周辺監視装置。 2. The vehicle periphery monitoring device according to claim 1, wherein the display unit displays the vehicle information and the captured image by projecting an optical image onto an image projection surface disposed in front of the driver's seat of the vehicle. A vehicle periphery monitoring device comprising an up-display device.
  5.  請求項1記載の車両周辺監視装置であって、前記判定部は、前記車両に搭載された音声出力部から警告音を出力させる音声信号と、前記表示部に警報情報を表示させる画像信号とのうちの少なくとも一方を前記通知信号として生成することを特徴とする車両周辺監視装置。 The vehicle periphery monitoring device according to claim 1, wherein the determination unit includes an audio signal that outputs a warning sound from an audio output unit mounted on the vehicle, and an image signal that displays alarm information on the display unit. At least one of them is produced | generated as said notification signal, The vehicle periphery monitoring apparatus characterized by the above-mentioned.
  6.  請求項1記載の車両周辺監視装置であって、前記後方車両と当該車両との間の車間距離を検出して当該車間距離を前記車両情報生成部に供給する測距部を更に備え、
     前記車両情報生成部は、前記車間距離を前記車両情報の一部として前記判定部に供給することを特徴とする車両周辺監視装置。
    The vehicle periphery monitoring device according to claim 1, further comprising a distance measuring unit that detects an inter-vehicle distance between the rear vehicle and the vehicle and supplies the inter-vehicle distance to the vehicle information generating unit.
    The vehicle information generation unit supplies the inter-vehicle distance to the determination unit as a part of the vehicle information.
  7.  請求項6記載の車両周辺監視装置であって、前記判定部は、前記車間距離が所定の近接距離以内であるときに前記後方車両が注目車両に該当すると判定することを特徴とする車両周辺監視装置。 The vehicle periphery monitoring device according to claim 6, wherein the determination unit determines that the rear vehicle corresponds to a vehicle of interest when the inter-vehicle distance is within a predetermined proximity distance. apparatus.
  8.  請求項6記載の車両周辺監視装置であって、
     前記車両情報生成部は、前記車両に対する前記後方車両の相対速度を前記車両情報の一部として算出し、
     前記判定部は、前記相対速度が所定の上限速度以上のときに、前記後方車両が注目車両に該当するか否かを判定することを特徴とする車両周辺監視装置。
    The vehicle periphery monitoring device according to claim 6,
    The vehicle information generation unit calculates a relative speed of the rear vehicle with respect to the vehicle as a part of the vehicle information,
    The determination unit determines whether or not the rear vehicle corresponds to a vehicle of interest when the relative speed is equal to or higher than a predetermined upper limit speed.
  9.  請求項6記載の車両周辺監視装置であって、
     前記車両情報生成部は、前記車両に対する前記後方車両の相対加速度を前記車両情報の一部として算出し、
     前記判定部は、前記相対加速度が所定の上限加速度以上のときに、前記後方車両が注目車両に該当するか否かを判定することを特徴とする車両周辺監視装置。
    The vehicle periphery monitoring device according to claim 6,
    The vehicle information generation unit calculates a relative acceleration of the rear vehicle with respect to the vehicle as a part of the vehicle information,
    The determination unit determines whether or not the rear vehicle corresponds to a vehicle of interest when the relative acceleration is equal to or greater than a predetermined upper limit acceleration.
  10.  請求項1記載の車両周辺監視装置であって、前記撮像画像を解析して前記後方車両の運転者の挙動を認識する運転者認識部を更に備え、
     前記判定部は、当該検出された挙動が特定条件に合致したときに、前記後方車両が注目車両に該当するか否かを判定することを特徴とする車両周辺監視装置。
    The vehicle periphery monitoring device according to claim 1, further comprising a driver recognition unit that analyzes the captured image and recognizes the behavior of the driver of the rear vehicle,
    The vehicle periphery monitoring device, wherein the determination unit determines whether or not the rear vehicle corresponds to a vehicle of interest when the detected behavior matches a specific condition.
  11.  車両の後方領域を撮像する撮像部と、当該車両の運転席の前方に配置された表示部と、車両周辺監視装置とを備えた運転支援システムであって、
     前記車両周辺監視装置は、
     前記撮像部から当該後方領域の撮像画像が入力される入力部と、
     前記撮像画像に現れる後方車両の動きを示す車両情報を生成する車両情報生成部と、
     前記車両情報に基づいて前記後方車両が注目車両に該当するか否かを判定し、前記後方車両が注目車両に該当すると判定したときに警報用の通知信号を生成して出力する判定部と、
     前記表示部に前記車両情報とともに前記撮像画像を並列表示させる表示制御部と
    を備えることを特徴とする運転支援システム。
    A driving support system comprising an imaging unit that images a rear region of a vehicle, a display unit disposed in front of a driver's seat of the vehicle, and a vehicle periphery monitoring device,
    The vehicle periphery monitoring device is
    An input unit to which a captured image of the rear region is input from the imaging unit;
    A vehicle information generation unit that generates vehicle information indicating the movement of the rear vehicle appearing in the captured image;
    A determination unit that determines whether or not the rear vehicle corresponds to a vehicle of interest based on the vehicle information, and generates and outputs a warning notification signal when it is determined that the rear vehicle corresponds to a vehicle of interest;
    A driving support system comprising: a display control unit configured to display the captured image together with the vehicle information on the display unit.
  12.  請求項11記載の運転支援システムであって、
     前記表示部は、前記車両の運転席の真正面に配置されたインストルメントパネルを含み、
     前記インストルメントパネルの表示画面は、前記車両の走行状態値を示す走行状態表示領域、前記撮像画像を表示する画像表示領域、及び、前記車両情報を表示する車両情報表示領域を有する、
    ことを特徴とする運転支援システム。
    The driving support system according to claim 11,
    The display unit includes an instrument panel disposed in front of the driver's seat of the vehicle,
    The display screen of the instrument panel has a running state display area indicating a running state value of the vehicle, an image display area for displaying the captured image, and a vehicle information display area for displaying the vehicle information.
    A driving support system characterized by that.
  13.  請求項11記載の運転支援システムであって、前記表示部は、当該車両の運転席の真正面に配置された画像投影面に光学像を投影して前記車両情報及び前記撮像画像を表示するヘッドアップディスプレイ装置を含むことを特徴とする運転支援システム。 12. The driving support system according to claim 11, wherein the display unit projects the optical image onto an image projection surface arranged in front of the driver's seat of the vehicle to display the vehicle information and the captured image. A driving support system comprising a display device.
PCT/JP2015/068818 2015-06-30 2015-06-30 Vehicle-surroundings monitoring device and driving support system WO2017002195A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2017525719A JP6342074B2 (en) 2015-06-30 2015-06-30 Vehicle periphery monitoring device and driving support system
PCT/JP2015/068818 WO2017002195A1 (en) 2015-06-30 2015-06-30 Vehicle-surroundings monitoring device and driving support system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/068818 WO2017002195A1 (en) 2015-06-30 2015-06-30 Vehicle-surroundings monitoring device and driving support system

Publications (1)

Publication Number Publication Date
WO2017002195A1 true WO2017002195A1 (en) 2017-01-05

Family

ID=57607972

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/068818 WO2017002195A1 (en) 2015-06-30 2015-06-30 Vehicle-surroundings monitoring device and driving support system

Country Status (2)

Country Link
JP (1) JP6342074B2 (en)
WO (1) WO2017002195A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018163096A (en) * 2017-03-27 2018-10-18 沖電気工業株式会社 Information processing method and information processing device
CN110312633A (en) * 2017-02-23 2019-10-08 松下知识产权经营株式会社 Image display system, image display method and program
WO2020208696A1 (en) * 2019-04-09 2020-10-15 三菱電機株式会社 Information recording control device and information recording control method
CN114394052A (en) * 2020-10-08 2022-04-26 丰田自动车株式会社 Vehicle display system and vehicle display method
US11341852B2 (en) 2018-02-26 2022-05-24 Nec Corporation Dangerous act resolution system, apparatus, method, and program

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004306779A (en) * 2003-04-07 2004-11-04 Denso Corp On-vehicle mirror display device
JP2009074888A (en) * 2007-09-20 2009-04-09 Alpine Electronics Inc Inter-vehicle distance measuring device
JP2013129386A (en) * 2011-12-22 2013-07-04 Toyota Motor Corp Vehicle rear monitoring apparatus
JP2014178971A (en) * 2013-03-15 2014-09-25 Denso Corp Vehicular collision warning device
JP2014229101A (en) * 2013-05-23 2014-12-08 日産自動車株式会社 Vehicular display device
JP2015009646A (en) * 2013-06-28 2015-01-19 アルパイン株式会社 Driving support device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004306779A (en) * 2003-04-07 2004-11-04 Denso Corp On-vehicle mirror display device
JP2009074888A (en) * 2007-09-20 2009-04-09 Alpine Electronics Inc Inter-vehicle distance measuring device
JP2013129386A (en) * 2011-12-22 2013-07-04 Toyota Motor Corp Vehicle rear monitoring apparatus
JP2014178971A (en) * 2013-03-15 2014-09-25 Denso Corp Vehicular collision warning device
JP2014229101A (en) * 2013-05-23 2014-12-08 日産自動車株式会社 Vehicular display device
JP2015009646A (en) * 2013-06-28 2015-01-19 アルパイン株式会社 Driving support device

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110312633A (en) * 2017-02-23 2019-10-08 松下知识产权经营株式会社 Image display system, image display method and program
JP2018163096A (en) * 2017-03-27 2018-10-18 沖電気工業株式会社 Information processing method and information processing device
JP7062878B2 (en) 2017-03-27 2022-05-09 沖電気工業株式会社 Information processing method and information processing equipment
US11341852B2 (en) 2018-02-26 2022-05-24 Nec Corporation Dangerous act resolution system, apparatus, method, and program
WO2020208696A1 (en) * 2019-04-09 2020-10-15 三菱電機株式会社 Information recording control device and information recording control method
JPWO2020208696A1 (en) * 2019-04-09 2021-09-13 三菱電機株式会社 Information record control device and information record control method
CN114394052A (en) * 2020-10-08 2022-04-26 丰田自动车株式会社 Vehicle display system and vehicle display method
CN114394052B (en) * 2020-10-08 2024-04-16 丰田自动车株式会社 Vehicle display system and vehicle display method

Also Published As

Publication number Publication date
JPWO2017002195A1 (en) 2017-08-24
JP6342074B2 (en) 2018-06-13

Similar Documents

Publication Publication Date Title
US10220778B2 (en) Vehicle-mounted alert system and alert control device
JP6342074B2 (en) Vehicle periphery monitoring device and driving support system
US10026320B2 (en) Vehicle and method for supporting driving safety thereof
JP6485328B2 (en) Vehicle driving support device
US20180297611A1 (en) Notice management apparatus and notice management method
US10919449B2 (en) Driving support device and storage medium
JP6516298B2 (en) Information display device
US20180157272A1 (en) Vehicle mounted apparatus
CN107533795B (en) Vehicle display device and vehicle display method
JPWO2015037117A1 (en) Information display system and information display device
JP2006227811A (en) Driving support apparatus
JP2016031648A (en) Vehicle-mounted device
JP2020093766A (en) Vehicle control device, control system and control program
KR20120045519A (en) Lane keeping control system, lane change control system and vehicle control system
JP5494729B2 (en) Approach notification device
GB2542942A (en) Tactical threat assessor for a vehicle
US11221495B2 (en) Aid for a driver with impaired field of view
CN113060156B (en) Vehicle surroundings monitoring device, vehicle surroundings monitoring method, and program
JP2023184778A (en) Vehicle display system and vehicle display method
JP4561627B2 (en) Vehicle periphery monitoring device
JP2005352636A (en) On-vehicle alarm generation device
JP6370249B2 (en) In-vehicle warning device
US20240010204A1 (en) Vehicle assistance device
WO2017042990A1 (en) Vehicular display device and vehicular display method
US20240078906A1 (en) System and method for providing well distinguishable warning levels for obstacles in different visibility areas in the vicinity of a vehicle

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15897122

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017525719

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15897122

Country of ref document: EP

Kind code of ref document: A1