JP2005165422A - Collision probability determination device - Google Patents

Collision probability determination device Download PDF

Info

Publication number
JP2005165422A
JP2005165422A JP2003400186A JP2003400186A JP2005165422A JP 2005165422 A JP2005165422 A JP 2005165422A JP 2003400186 A JP2003400186 A JP 2003400186A JP 2003400186 A JP2003400186 A JP 2003400186A JP 2005165422 A JP2005165422 A JP 2005165422A
Authority
JP
Japan
Prior art keywords
vehicle
driver
line
pedestrian
bicycle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2003400186A
Other languages
Japanese (ja)
Other versions
JP4134891B2 (en
Inventor
Kazumi Isaji
和美 伊佐治
Naohiko Tsuru
直彦 津留
Takahiro Wada
隆広 和田
Hiroshi Kaneko
弘 金子
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Priority to JP2003400186A priority Critical patent/JP4134891B2/en
Publication of JP2005165422A publication Critical patent/JP2005165422A/en
Application granted granted Critical
Publication of JP4134891B2 publication Critical patent/JP4134891B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Traffic Control Systems (AREA)
  • Regulating Braking Force (AREA)
  • Control Of Vehicle Engines Or Engines For Specific Uses (AREA)

Abstract

<P>PROBLEM TO BE SOLVED: To provide a collision probability determination device which adequately determines a probability of colliding with its own vehicle. <P>SOLUTION: The collision probability determination device recognizes objects of pedestrians, bicycles, other vehicles and so on ahead of its own vehicle (S10) and specifies the directions of lines of sight of the recognized pedestrians, drivers of the recognized bicycles, drivers of other recognized vehicles and so on (S20). Then, the above determination device gives the alarm from its own vehicle to arouse the attention of pedestrians, drivers of the bicycles, or drivers of other vehicles, who do not direct their lines of sight toward its own vehicle (S40) when it is determined that the specified lines of sight are not directed toward its own vehicle (S30). <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

本発明は、自車両の周囲に存在する物体との衝突可能性を判定する衝突可能性判定装置に関するものである。   The present invention relates to a collision possibility determination device that determines the possibility of collision with an object existing around a host vehicle.

従来、障害物に関する情報を、その障害物に対する運転者の認識度合いに応じて提供する車両用情報提供装置が提案されている(例えば、特許文献1参照。)。この特許文献1に開示されている車両用情報提供装置によれば、例えば、注視点検出センサによって自車両の運転者の注視点を検出し、前方に存在する障害物に対して、前方障害物センサによって自車両との位置関係が検出されているときには、その障害物が、検出された注視点を基準として設定した視野範囲内に相当する位置に存在するか否かに応じて、その障害物に関する情報提供の態様を変更する。
特開2001−357498号公報
Conventionally, a vehicle information providing device that provides information related to an obstacle according to the degree of recognition of the driver with respect to the obstacle has been proposed (see, for example, Patent Document 1). According to the vehicle information providing device disclosed in Patent Document 1, for example, a gaze point of a driver of the host vehicle is detected by a gaze point detection sensor, and a front obstacle is detected with respect to an obstacle existing ahead. When the positional relationship with the host vehicle is detected by the sensor, the obstacle is determined depending on whether the obstacle exists at a position corresponding to the visual field range set with the detected gazing point as a reference. Change the mode of information provision.
JP 2001-357498 A

上述した、従来の車両用情報提供装置は、運転者の視野範囲に基づいて情報提供の対象とすべき障害物を選定しているため、自車両と衝突する可能性のない物体についても情報提供の対象とすることがあり、その結果、運転者に対して不要な情報を提供することになる。   Since the conventional vehicle information providing apparatus described above selects an obstacle to be provided based on the visual field range of the driver, it also provides information on an object that may not collide with the host vehicle. As a result, unnecessary information is provided to the driver.

本発明は、かかる問題を鑑みてなされたもので、自車両との衝突可能性を的確に判定することができる衝突可能性判定装置を提供することを目的とする。   The present invention has been made in view of such problems, and an object of the present invention is to provide a collision possibility determination device that can accurately determine the possibility of collision with the host vehicle.

請求項1に記載の衝突可能性判定装置は、自車両の周囲の画像を撮影する撮像手段と、撮像手段の撮影した画像から、歩行者、自転車、及び、他車両の少なくとも1つを認識する認識手段と、認識手段の認識する歩行者、自転車の運転者、及び、他車両の運転者の少なくとも1人の視線方向を特定する視線方向特定手段と、視線方向特定手段によって特定される視線方向が自車両の存在する方向であるか否かを判定する視線方向判定手段と、視線方向判定手段の判定結果に基づいて、視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つと自車両との衝突可能性を判定する衝突可能性判定手段とを備えることを特徴とする。   The collision possibility determination device according to claim 1 recognizes at least one of a pedestrian, a bicycle, and another vehicle from an imaging unit that captures an image around the host vehicle and an image captured by the imaging unit. Recognizing means, gaze direction identifying means for identifying the gaze direction of at least one of a pedestrian, a bicycle driver, and a driver of another vehicle recognized by the recognizing means, and a gaze direction identified by the gaze direction identifying means Gazing direction determination means for determining whether the vehicle is in the direction in which the host vehicle is present, a pedestrian who has identified the sight line direction based on the determination result of the sight line direction determination means, a bicycle driven by the driver, and driving It is provided with the collision possibility determination means which determines the collision possibility of at least 1 of the other vehicles which a person drives, and the own vehicle.

人は、視覚によって物体を認識する際、その物体の存在する方向へ視線を向けるが、人の視線が向けられている車両からみれば、その視線を向けている人は、車両の存在を認識するために視線を向けているものと判断できる。そして、その存在を認識した車両と今後接触したり、衝突したりすることが無いように、例えば、自ら進む方向を変更したり、車両に対して自身の存在を気付かせるようにしたりする。   When a person recognizes an object visually, he or she looks in the direction that the object exists, but from the perspective of the vehicle where the person's line of sight is directed, the person who is looking at the person recognizes the presence of the vehicle Therefore, it can be determined that the user is looking at him. Then, for example, the direction in which the vehicle travels is changed or the vehicle is made aware of its presence so that it will not contact or collide with the vehicle that has recognized its presence.

このように、本発明は、自車両に視線を向けている歩行者、自転車の運転者、他車両の運転者等は、自車両の存在を認識しているものと想定できることに着目したもので、すなわち、歩行者、自転車の運転者、及び、他車両の運転者等の視線方向が自車両の存在する方向であるか否かの判定を行う。これにより、自車両との衝突可能性を判定することができる。   As described above, the present invention focuses on the fact that pedestrians, bicycle drivers, drivers of other vehicles, and the like who are looking at the own vehicle can be assumed to recognize the existence of the own vehicle. That is, it is determined whether the line-of-sight direction of a pedestrian, a bicycle driver, a driver of another vehicle, or the like is a direction in which the host vehicle exists. Thereby, the possibility of collision with the host vehicle can be determined.

請求項2に記載の衝突可能性判定装置によれば、視線方向特定手段は、撮像手段の撮影した画像から人の顔を特徴付ける特徴点を抽出する特徴点抽出手段を備え、この特徴点抽出手段によって抽出される歩行者、及び自転車の運転者の少なくとも1人の顔の特徴点に基づいて、歩行者、及び自転車の運転者の少なくとも1人の顔面の向く方向を特定することで、歩行者、及び自転車の運転者の少なくとも1人の視線方向を特定することを特徴とする。   According to the collision possibility determination device according to claim 2, the line-of-sight direction specifying unit includes a feature point extracting unit that extracts a feature point characterizing a human face from an image captured by the imaging unit, and the feature point extracting unit. By identifying the direction of the face of at least one of the pedestrian and the bicycle driver based on the feature points of the face of at least one of the pedestrian and the bicycle driver extracted by the pedestrian, And the direction of the line of sight of at least one of the bicycle drivers.

一般に、人の視野は、目で見たときに注目している領域(中心視)とその周辺(周辺視)とに大別され、この中心視と周辺視とでは認知能力が異なる。すなわち、人は、中心視で見ている対象が何であるかを認識することができるものの、周辺視では、何であるのかを認識することが難しくなり、その傾向は、中心視から離れるほど強くなる。そのため、人は、物体を認識する際、その物体が中心視内に位置するように、その認識すべき物体の方向へ顔を向ける。本発明は、この点に着目し、歩行者や自転車の運転者の顔面の向く方向を特定することよって、その歩行者や自転車の運転者の視線方向を特定することができる。   In general, the visual field of a person is roughly divided into a region of interest (central vision) when viewed with the eyes and its periphery (peripheral vision), and the cognitive ability differs between the central vision and the peripheral vision. In other words, humans can recognize what they are looking at in central vision, but it is difficult to recognize what they are in peripheral vision, and the tendency becomes stronger as they move away from central vision. . Therefore, when recognizing an object, a person turns his / her face toward the object to be recognized so that the object is located in the central vision. The present invention pays attention to this point, and by specifying the direction in which the face of the pedestrian or bicycle driver faces, the direction of the line of sight of the pedestrian or bicycle driver can be specified.

請求項3に記載の衝突可能性判定装置によれば、他車両は、他車両の運転者の視線方向を検出する他車視線方向検出手段と、他車視線方向検出手段の検出する運転者の視線方向に関する情報を自車両へ送信する他車両通信手段とを備え、自車両は、他車両通信手段との通信接続を行う自車両通信手段を備え、視線方向特定手段は、他車両の運転者の視線方向として、自車両通信手段の受信する他車両の運転者の視線方向に関する情報から特定することを特徴とする。これにより、他車両の運転者の視線方向が自車両に向けられているか否か判断することができる。   According to the collision possibility determination device according to claim 3, the other vehicle is configured so that the other vehicle's line-of-sight direction detecting unit detects the line-of-sight direction of the driver of the other vehicle and the driver's detected by the other vehicle's line-of-sight direction detecting unit. Other vehicle communication means for transmitting information related to the line-of-sight direction to the own vehicle, the own vehicle includes own vehicle communication means for performing communication connection with the other vehicle communication means, and the line-of-sight direction specifying means is a driver of the other vehicle. The sight line direction is specified from information on the sight line direction of the driver of the other vehicle received by the own vehicle communication means. Thereby, it is possible to determine whether or not the driver's line-of-sight direction of the other vehicle is directed toward the host vehicle.

請求項4に記載の衝突可能性判定装置によれば、衝突可能性判定手段は、視線方向判定手段によって、視線方向特定手段の特定する視線方向が自車両の存在する方向でないと判定される場合に、視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つと自車両とが衝突する可能性が有ると判定することを特徴とする。これにより、自車両と衝突する可能性の有る歩行者、自転車、他車両等を特定することができる。   According to the collision possibility determination device of the fourth aspect, when the collision possibility determination unit determines that the line-of-sight direction specified by the line-of-sight direction determination unit is not the direction in which the host vehicle exists. In addition, it is determined that there is a possibility that the host vehicle collides with at least one of a pedestrian who has specified the line-of-sight direction, a bicycle driven by the driver, and another vehicle driven by the driver. Thereby, a pedestrian, a bicycle, another vehicle, etc. with a possibility of colliding with the own vehicle can be specified.

請求項5に記載の衝突可能性判定装置は、衝突可能性判定手段によって、視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つと自車両とが衝突する可能性が有ると判定される場合、視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つに対して警報を発生する警報発生手段を備えることを特徴とする。例えば、自車両の警笛を発生したり、自車両のヘッドライトを点灯したりすることで、自車両と衝突する可能性の有る物体に対して、自車両に注意を向けさせることができる。   According to a fifth aspect of the present invention, there is provided a collision possibility determination device including at least one of a pedestrian whose direction of sight is identified by a collision possibility determination unit, a bicycle driven by the driver, and another vehicle driven by the driver, and the own vehicle. Alarm that generates an alarm for at least one of the pedestrian who specified the line-of-sight direction, the bicycle driven by the driver, and other vehicles driven by the driver. A generation means is provided. For example, by generating a horn of the host vehicle or turning on a headlight of the host vehicle, attention can be directed to the host vehicle with respect to an object that may collide with the host vehicle.

請求項6に記載の衝突可能性判定装置は、衝突可能性判定手段によって、視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つと自車両とが衝突する可能性が有ると判定される場合、自車両の走行に制限を加える走行制限手段を備えることを特徴とする。これにより、自車両に視線を向けていない歩行者、運転者の運転する自転車や他車両と衝突する可能性を低くすることができる。   The collision possibility determination device according to claim 6 is a self-vehicle and at least one of a pedestrian whose sight line direction is specified by a collision possibility determination unit, a bicycle driven by the driver, and another vehicle driven by the driver. When it is determined that there is a possibility that the vehicle will collide with the vehicle, a travel restriction unit that restricts the travel of the host vehicle is provided. Thereby, it is possible to reduce the possibility of collision with a pedestrian who is not looking at the own vehicle, a bicycle driven by the driver, or another vehicle.

請求項7に記載の衝突可能性判定装置によれば、走行制限手段は、自車両のアクセルペダルの開閉操作における開側への操作を制限することを特徴とする。これにより、衝突する可能性の有る歩行者、運転者の運転する自転車や他車両に接近する時間を遅らせることができる。その結果、自車両に視線を向けていない歩行者や運転者に対して、自車両の存在を気付かせるまでの時間を長くすることができる。   According to the collision possibility determination device of the seventh aspect, the travel restriction means restricts the operation to the open side in the opening / closing operation of the accelerator pedal of the host vehicle. Thereby, the time which approaches the pedestrian who may collide, the bicycle which a driver drives, and other vehicles can be delayed. As a result, it is possible to lengthen the time until the pedestrian or driver who has not turned his or her line of sight toward the own vehicle is made aware of the presence of the own vehicle.

請求項8に記載の衝突可能性判定装置によれば、自車両は、自動的に制動装置を駆動する自動制動手段を備え、走行制限手段は、自動制動手段による自動制動を行うことを特徴とする。これにより、自車両に視線を向けていない歩行者、運転者の運転する自転車や他車両と衝突する可能性をさらに低くすることができる。   According to the collision possibility determination device of the eighth aspect, the host vehicle includes automatic braking means that automatically drives the braking device, and the travel restriction means performs automatic braking by the automatic braking means. To do. Thereby, it is possible to further reduce the possibility of collision with a pedestrian who is not looking at the own vehicle, a bicycle driven by the driver, or another vehicle.

請求項9に記載の衝突可能性判定装置によれば、請求項1〜8のいずれか1項に記載の衝突可能性判定装置は、モータを動力源として駆動する車両に適用されることを特徴とする。すなわち、モータを動力源として駆動するハイブリッド車、電気自動車、燃料電池車等は、従来のエンジンを動力源として駆動する車両に比べ、走行時の騒音が低い。そのため、歩行者や自転車の運転者は、車両の接近に気付き難くなる。   According to the collision possibility determination device according to claim 9, the collision possibility determination device according to any one of claims 1 to 8 is applied to a vehicle driven by using a motor as a power source. And That is, a hybrid vehicle, an electric vehicle, a fuel cell vehicle, and the like that are driven using a motor as a power source have lower noise during traveling than a vehicle that is driven using a conventional engine as a power source. Therefore, it is difficult for pedestrians and bicycle drivers to notice the approach of the vehicle.

従って、本発明の衝突可能性判定装置をモータを動力源として駆動する車両に適用することで、自車両に視線を向けていない歩行者、運転者の運転する自転車や他車両との衝突可能性の有無を判定することができる。   Therefore, by applying the collision possibility determination device of the present invention to a vehicle driven by using a motor as a power source, there is a possibility of collision with a pedestrian who is not looking at the own vehicle, a bicycle driven by the driver, or another vehicle. The presence or absence of can be determined.

以下、本発明の衝突可能性判定装置について、図面に基づいて説明する。なお、本実施形態では、車両の運転を支援する運転支援装置の一機能として、本発明の衝突可能性判定装置を適用した例について説明する。   Hereinafter, the collision possibility determination device of the present invention will be described with reference to the drawings. In the present embodiment, an example in which the collision possibility determination device of the present invention is applied as one function of a driving support device that supports driving of a vehicle will be described.

図1に、本実施形態における運転支援装置の全体構成を示す。同図のように、運転支援装置200は、スロットル開度センサ10、ステアリングセンサ20、レーザレーダセンサ30、ヨーレートセンサ40、車速センサ50、可視カメラ62、赤外カメラ64、ナビゲーション装置70を備え、これら各構成はコンピュータ80に接続される。   In FIG. 1, the whole structure of the driving assistance device in this embodiment is shown. As shown in the figure, the driving support device 200 includes a throttle opening sensor 10, a steering sensor 20, a laser radar sensor 30, a yaw rate sensor 40, a vehicle speed sensor 50, a visible camera 62, an infrared camera 64, and a navigation device 70. Each of these components is connected to a computer 80.

また、運転支援装置200は、スロットル駆動器90、ブレーキ駆動器100、ステアリング駆動器110、自動変速機制御器120、表示装置130、入力装置140、警報装置150、及び通信装置160をさらに備え、各々コンピュータ80に接続される。   The driving support device 200 further includes a throttle driver 90, a brake driver 100, a steering driver 110, an automatic transmission controller 120, a display device 130, an input device 140, an alarm device 150, and a communication device 160. Each is connected to a computer 80.

コンピュータ80は、図示しない入出力インターフェース(I/O)および各種の駆動回路を備えている。これらのハード構成は一般的なものであるので、その構成に関する詳細な説明については省略する。このコンピュータ80は、自車両の周囲に存在する歩行者、自転車、及び他車両との衝突可能性を判定し、この判定の結果、衝突する可能性があると判定される場合に、その衝突する可能性のある歩行者や他車両に対して警報を発生する警報発生処理を実行する。   The computer 80 includes an input / output interface (I / O) (not shown) and various drive circuits. Since these hardware configurations are general, a detailed description of the configuration will be omitted. The computer 80 determines the possibility of collision with pedestrians, bicycles, and other vehicles existing around the host vehicle. If it is determined that there is a possibility of collision as a result of the determination, the computer 80 collides. An alarm generation process for generating an alarm for a possible pedestrian or other vehicle is executed.

また、コンピュータ80は、各センサからの情報に基づいて、スロットル駆動器90、ブレーキ駆動器100、ステアリング駆動器110、自動変速機制御器120等を駆動して、自車両の走行車線を維持して走行させる車線維持走行制御や、先行車両との車間時間を適切な車間時間となるように維持して走行させる車間距離制御等の運転操作を支援する運転支援処理も実行する。   Further, the computer 80 drives the throttle driver 90, the brake driver 100, the steering driver 110, the automatic transmission controller 120, and the like based on information from each sensor, and maintains the traveling lane of the host vehicle. Driving support processing for supporting driving operations such as lane keeping running control for running the vehicle, and inter-vehicle distance control for running the vehicle while keeping the inter-vehicle time with the preceding vehicle at an appropriate inter-vehicle time.

スロットル開度センサ10は、スロットルバルブの開度を検出するものである。この検出したスロットルバルブの開度信号は、コンピュータ80に送られる。ステアリングセンサ20は、ハンドルの操舵角の変更量を検出するものであり、その値から相対的な操舵角が検出される。   The throttle opening sensor 10 detects the opening of the throttle valve. The detected throttle valve opening signal is sent to the computer 80. The steering sensor 20 detects a change amount of the steering angle of the steering wheel, and a relative steering angle is detected from the value.

レーザレーダセンサ30は、レーザ光を車両前方の所定範囲に照射することにより、そのレーザ光を反射する反射物体との距離、相対速度、及び自車両に対する反射物体の方位等を検出する。この検出結果から構成される物体情報は、電気信号に変換されたのちコンピュータ80へ出力される。なお、このレーザレーダセンサ30は、レーザ光を用いて物体を検出するものであるが、ミリ波やマイクロ波等の電波や超音波等を用いて車両周囲の物体を検出するものであってもよい。   The laser radar sensor 30 irradiates a predetermined range in front of the vehicle with the laser beam, thereby detecting the distance to the reflecting object that reflects the laser beam, the relative speed, the direction of the reflecting object with respect to the host vehicle, and the like. The object information composed of the detection result is converted into an electrical signal and then output to the computer 80. The laser radar sensor 30 detects an object using laser light, but may detect an object around the vehicle using radio waves such as millimeter waves and microwaves, ultrasonic waves, and the like. Good.

ヨーレートセンサ40は、車両の鉛直方向周りの角速度を検出する。車速センサ50は、車輪の回転速度に対応した信号を検出するセンサである。可視カメラ62は、自車両前方の所定範囲内を撮影する撮像手段として用いられる光学式のカメラであり、撮影画像を電気信号に変換してコンピュータ80へ出力する。   The yaw rate sensor 40 detects an angular velocity around the vertical direction of the vehicle. The vehicle speed sensor 50 is a sensor that detects a signal corresponding to the rotational speed of the wheel. The visible camera 62 is an optical camera that is used as an imaging unit that captures a predetermined range in front of the host vehicle. The visible camera 62 converts the captured image into an electrical signal and outputs the electrical signal to the computer 80.

赤外カメラ64は、図示しない赤外投光ランプから自車両前方の所定範囲内に投光される赤外光の反射光を撮影する撮影手段として用いられるカメラであり、撮影画像を電気信号に変換してコンピュータ80へ出力する。なお、この赤外カメラ64は、上述した可視カメラ62の撮影範囲と同じ範囲内を撮影する。   The infrared camera 64 is a camera used as photographing means for photographing reflected light of infrared light projected within a predetermined range in front of the host vehicle from an unillustrated infrared projection lamp, and the photographed image is converted into an electrical signal. The data is converted and output to the computer 80. The infrared camera 64 captures the same range as the imaging range of the visible camera 62 described above.

ナビゲーション装置70は、周知のごとく、自車両の現在位置周辺の地図を表示する地図表示機能等の各種機能を実行するものであり、GPS(Global Positioning System)衛星からの電波に基づいて自車両の位置(緯度、経度)を検出するGPS受信機や自車両の進行方向の絶対方位を検出する地磁気センサを備える。また、地図を表示するための地図データ等を入力する地図データ入力器等も備える。   As is well known, the navigation device 70 executes various functions such as a map display function for displaying a map around the current position of the vehicle, and based on radio waves from a GPS (Global Positioning System) satellite. A GPS receiver for detecting the position (latitude, longitude) and a geomagnetic sensor for detecting the absolute direction of the traveling direction of the host vehicle are provided. Also provided is a map data input device for inputting map data for displaying a map.

スロットル駆動器90、ブレーキ駆動器100、ステアリング駆動器110、及び自動変速機制御器120は、いずれもコンピュータ80からの指示に応じて駆動するものである。スロットル駆動器90は、スロットルバルブの開度を調節し、内燃機関の出力を制御する。ブレーキ駆動器100はブレーキ圧力を調節し、ステアリング駆動器110はステアリングに回転トルクを発生させることで、ステアリングを駆動する。自動変速機制御器120は、車両の速度を制御する上で必要な、自動変速機のギヤ位置を選択するものである。   The throttle driver 90, the brake driver 100, the steering driver 110, and the automatic transmission controller 120 are all driven according to instructions from the computer 80. The throttle driver 90 controls the output of the internal combustion engine by adjusting the opening of the throttle valve. The brake driver 100 adjusts the brake pressure, and the steering driver 110 drives the steering by generating rotational torque in the steering. The automatic transmission controller 120 selects the gear position of the automatic transmission necessary for controlling the speed of the vehicle.

表示装置130は、例えば、液晶ディスプレイによって構成され、車室内のセンターコンソール付近に設置される。この表示装置130には、ナビゲーション装置70から出力される地図表示の画像データや、コンピュータ80から出力される運転者に対して注意を喚起するための警告表示の画像データ等を入力し、各画像データに対応した画像を表示する。   The display device 130 is configured by a liquid crystal display, for example, and is installed near the center console in the vehicle interior. The display device 130 receives map display image data output from the navigation device 70, warning display image data for alerting the driver output from the computer 80, and the like. Display the image corresponding to the data.

入力装置140は、例えば、表示装置130と一体になったタッチスイッチもしくはメカニカルなスイッチ等が用いられ、文字入力等の各種入力に使用される。警報装置150は、運転者への注意を喚起するための警報音を発生する装置であり、コンピュータ80からの指示に応じた警報を出力する。   As the input device 140, for example, a touch switch or a mechanical switch integrated with the display device 130 is used, and is used for various inputs such as character input. The alarm device 150 is a device that generates an alarm sound for alerting the driver, and outputs an alarm according to an instruction from the computer 80.

例えば、車線維持走行制御においては、自車両が走行車線を逸脱するような場合に警報を出力したり、また、車間距離制御においては、自車両が前方車両に急接近し、車間距離制御の制御限界を超えるような場合に警報を出力したりする。通信機160は、他車両との移動通信を可能にする移動通信機である。   For example, in the lane keeping traveling control, an alarm is output when the own vehicle departs from the traveling lane. In the inter-vehicle distance control, the own vehicle suddenly approaches the preceding vehicle, and the inter-vehicle distance control is controlled. An alarm is output when the limit is exceeded. Communication device 160 is a mobile communication device that enables mobile communication with other vehicles.

次に、コンピュータ80の制御ブロック図を図2に示す。同図に示すように、コンピュータ80は、入出力部81、物体認識部82、視線方向特定部83、衝突可能性判定部84、及び警報発生部85の各ブロックに分けられる。   Next, a control block diagram of the computer 80 is shown in FIG. As shown in the figure, the computer 80 is divided into blocks of an input / output unit 81, an object recognition unit 82, a line-of-sight direction identification unit 83, a collision possibility determination unit 84, and an alarm generation unit 85.

図2に示す入出力部81は、各種センサ等から出力された信号を入力するとともに、コンピュータ80内で処理された出力信号を出力する。物体認識部82は、可視カメラ62や赤外カメラ64によって撮影された撮影画像に対して所定の画像処理を行い、その画像処理された画素毎の画像データから、歩行者、自転車、車両を特徴付ける特徴点(量)を抽出する特徴抽出処理を行って、自車両前方の歩行者、自転車、他車両等の物体を認識する。例えば、図3に示すような自車両前方の画像が撮影される場合には、画像内の歩行者P1、P2、P3、自転車B、及び他車両Vを認識する。   An input / output unit 81 shown in FIG. 2 inputs signals output from various sensors and the like, and outputs an output signal processed in the computer 80. The object recognition unit 82 performs predetermined image processing on a photographed image photographed by the visible camera 62 or the infrared camera 64, and characterizes a pedestrian, a bicycle, or a vehicle from the image data for each pixel subjected to the image processing. A feature extraction process for extracting feature points (amounts) is performed to recognize objects such as pedestrians, bicycles, and other vehicles in front of the host vehicle. For example, when an image in front of the host vehicle as shown in FIG. 3 is taken, pedestrians P1, P2, P3, bicycle B, and other vehicle V in the image are recognized.

なお、歩行者、自転車、他車両等の物体を認識する際、可視カメラ62の撮影画像に対しては、縦横比や形状等の特徴量の抽出を行い、赤外カメラ64の撮影画像に対しては、温度の高低、温度分布等の特徴量の抽出を行う。そして、各々の画像から抽出された特徴量から総合して、その物体が歩行者、自転車、他車両のいずれかに該当する物体であるかを認識する。   When recognizing objects such as pedestrians, bicycles, and other vehicles, feature amounts such as aspect ratio and shape are extracted from the captured image of the visible camera 62, and the captured image of the infrared camera 64 is extracted. In this case, feature quantities such as temperature level and temperature distribution are extracted. Then, based on the feature values extracted from each image, it is recognized whether the object is an object corresponding to a pedestrian, a bicycle, or another vehicle.

視線方向特定部83は、物体認識部82によって認識された歩行者の視線方向、自転車の運転者の視線方向、他車両の運転者等の視線方向を特定する。ここで、歩行者、及び自転車の運転者の視線方向については、可視カメラ62や赤外カメラ64によって撮影された撮影画像に対して画像処理された画素毎の画像データから、歩行者や運転者の顔画像部分を抽出し、その抽出した顔画像部分に含まれる複数の特徴点(例えば、目頭、目尻、鼻孔等)の位置を検出し、この検出した位置に基づいて、画像上における顔面が向けられている方向を求める。そして、この求まった顔面の方向を視線方向として特定する。   The line-of-sight direction specifying unit 83 specifies the line-of-sight direction of a pedestrian recognized by the object recognition unit 82, the line-of-sight direction of a bicycle driver, and the line-of-sight direction of a driver of another vehicle. Here, with regard to the line-of-sight directions of pedestrians and bicycle drivers, pedestrians and drivers are obtained from image data for each pixel that has been image-processed with respect to the images captured by the visible camera 62 and the infrared camera 64. The face image portion is extracted, the positions of a plurality of feature points (for example, the eyes, corners of the eyes, nostrils, etc.) included in the extracted face image portion are detected, and the face on the image is determined based on the detected positions. Find the direction you are headed. Then, the obtained face direction is specified as the line-of-sight direction.

すなわち、上述したように、一般に、人の視野は、目で見たときに注目している領域(中心視)とその周辺(周辺視)とに大別され、この中心視と周辺視とでは認知能力が異なる。すなわち、人は、中心視で見ている対象が何であるかを認識することができるものの、周辺視では、何であるのかを認識することが難しくなり、その傾向は、中心視から離れるほど強くなる。   That is, as described above, in general, the human visual field is roughly divided into an area of interest (central vision) when viewed with the eyes and its peripheral area (peripheral vision). Cognitive ability is different. In other words, humans can recognize what they are looking at in central vision, but it is difficult to recognize what they are in peripheral vision, and the tendency becomes stronger as they move away from central vision. .

そのため、人は、物体を認識する際、その物体が中心視内に位置するように、その認識すべき物体の方向へ顔を向ける。本発明は、この点に着目し、歩行者の顔面の向く方向から視線方向を特定する。これにより、歩行者、自転車を運転する運転者の視線方向を特定することができる。なお、画像上における顔面の向けられている方向は、座標変換等を行って絶対方位に変換しておき、自車両の存在する位置(緯度、経度)対応付けができるようにしておく。   Therefore, when recognizing an object, a person turns his / her face toward the object to be recognized so that the object is located in the central vision. The present invention pays attention to this point and specifies the line-of-sight direction from the direction in which the face of the pedestrian faces. Thereby, the sight line direction of the pedestrian and the driver who drives the bicycle can be specified. Note that the direction of the face on the image is converted into an absolute direction by performing coordinate conversion or the like so that the position (latitude and longitude) where the host vehicle exists can be associated.

また、他車両の運転者の視線方向については、通信機160を介して、自車両周囲の他車両に対して、運転者の視線方向の情報を自車両に送信する送信依頼信号を送信し、この送信依頼信号を受けた他車両からその車両の運転者の視線方向の情報を取得する。自車両からの送信依頼信号を受信した他車両は、運転者の現在の視線方向を取得し、絶対方位に変換する。そして、この絶対方位に変換した視線方向に関する情報を送信依頼信号を送信した自車両に対して送信する。これにより、自車両において、他車両の運転者の視線方向を取得することができる。   In addition, for the driver's line-of-sight direction of the other vehicle, a transmission request signal is transmitted to the other vehicle around the host vehicle via the communication device 160 to transmit information on the driver's line-of-sight direction to the host vehicle. Information on the line-of-sight direction of the driver of the vehicle is acquired from the other vehicle that has received the transmission request signal. The other vehicle that has received the transmission request signal from the host vehicle acquires the driver's current line-of-sight direction and converts it to an absolute direction. And the information regarding the gaze direction converted into this absolute azimuth | direction is transmitted with respect to the own vehicle which transmitted the transmission request signal. Thereby, the gaze direction of the driver of the other vehicle can be acquired in the own vehicle.

なお、他車両においては、運転者の視線方向を検出する手段と、その検出した視線方向の情報を自車両へ送信する通信手段を備える必要があるが、運転者の視線方向を検出する手段としては、例えば、特開2001−357498号公報に開示されている注視点検出センサ、赤外投光ランプ、赤外領域撮像カメラ等を採用することができる。   In other vehicles, it is necessary to include means for detecting the driver's line-of-sight direction and communication means for transmitting information on the detected line-of-sight direction to the host vehicle. For example, a gazing point detection sensor, an infrared floodlight lamp, an infrared region imaging camera, or the like disclosed in JP 2001-357498 A can be used.

衝突可能性判定部84は、視線方向特定部83からの歩行者、自転車の運転者、他車両の運転者等の視線方向を用いて、自車両前方に存在する歩行者、自転車、他車両等と自車両との衝突可能性の有無を判定する。ここでは、歩行者、自転車の運転者、他車両の運転者等の視線方向が自車両の存在する方向でないと判定される場合に、その自車両の存在する方向に視線を向けていない運転者が運転する自転車や他車両、あるいは、歩行者と自車両とが衝突する可能性が有ると判定する。   The collision possibility determination unit 84 uses the line-of-sight directions of the pedestrian, the bicycle driver, the driver of another vehicle, etc. from the line-of-sight direction specifying unit 83, and the pedestrian, bicycle, other vehicle, etc. existing in front of the host vehicle. And whether there is a possibility of collision with the host vehicle. Here, when it is determined that the line-of-sight direction of a pedestrian, a bicycle driver, a driver of another vehicle, etc. is not the direction in which the own vehicle exists, the driver who does not turn his / her line of sight in the direction in which the own vehicle exists It is determined that there is a possibility of collision between a bicycle or other vehicle driven by the vehicle, or a pedestrian and the host vehicle.

すなわち、上述したように、人は、視覚によって物体を認識する際、その物体の存在する方向へ視線を向けるが、人の視線が向けられている車両からみれば、その視線を向けている人は、車両の存在を認識するために視線を向けているものと判断できる。そして、その存在を認識した車両と今後接触したり、衝突したりすることが無いように、例えば、自ら進む方向を変更したり、車両に対して自身の存在を気付かせるようにしたりする。   That is, as described above, when a person visually recognizes an object, the person turns his / her line of sight in the direction in which the object exists. It can be determined that the user is looking in order to recognize the presence of the vehicle. Then, for example, the direction in which the vehicle travels is changed or the vehicle is made aware of its presence so that it will not contact or collide with the vehicle that has recognized its presence.

このように、本発明は、自車両に視線を向けている歩行者、自転車の運転者、他車両の運転者等は、自車両の存在を認識しているものと想定できることに着目したもので、すなわち、歩行者、自転車の運転者、及び、他車両の運転者等の視線方向が自車両の存在する方向であるか否かを判定することで、自車両との衝突可能性の有無を判定する。なお、この衝突可能性の有無の判定結果は、警報発生部85へ送られる。   As described above, the present invention focuses on the fact that pedestrians, bicycle drivers, drivers of other vehicles, and the like who are looking at the own vehicle can be assumed to recognize the existence of the own vehicle. That is, whether or not there is a possibility of collision with the own vehicle by determining whether or not the line of sight of the pedestrian, the driver of the bicycle, the driver of the other vehicle, etc. is the direction in which the own vehicle exists. judge. Note that the determination result of the possibility of collision is sent to the alarm generation unit 85.

図2に示す警報発生部85は、衝突可能性判定部84によって、歩行者、自転車、あるいは他車両との衝突の可能性が有るとの判定結果を受けた場合、これらの物体に対して警報を発生する。例えば、自車両の警笛を発生したり、自車両のヘッドライトを点灯したりする。これにより、自車両と衝突する可能性の有る歩行者、自転車、あるいは他車両等の物体に対して、自車両に注意を向けさせることができる。   2 receives a determination result that there is a possibility of a collision with a pedestrian, a bicycle, or another vehicle by the collision possibility determination unit 84, the warning generation unit 85 warns these objects. Is generated. For example, the horn of the own vehicle is generated or the headlight of the own vehicle is turned on. Thereby, attention can be directed to the own vehicle with respect to an object such as a pedestrian, a bicycle, or another vehicle that may collide with the own vehicle.

次に、本実施形態の特徴部分に係わる、運転支援装置200による警報発生処理について、図4に示すフローチャートを用いて説明する。先ず、図7に示すステップ(以下、Sと記す)10では、自車両前方に存在する歩行者、自転車、他車両等の物体を認識する。S20では、S10において認識された歩行者、自転車の運転者、他車両の運転者等の視線方向を特定する。   Next, alarm generation processing by the driving support apparatus 200 related to the characteristic part of the present embodiment will be described with reference to the flowchart shown in FIG. First, in step (hereinafter referred to as “S”) 10 shown in FIG. 7, an object such as a pedestrian, bicycle, or other vehicle existing in front of the host vehicle is recognized. In S20, the line-of-sight directions of the pedestrian, the bicycle driver, the driver of another vehicle, etc. recognized in S10 are specified.

S30では、この特定された視線方向が自車両の存在する方向へ向けられているか否かを判定する。ここで、肯定判定される場合にはS10へ処理を移行し、上述した処理を繰り返し行う。一方、否定判定される場合には、自車両の存在する方向へ視線を向けていない運転者の運転する自転車や他車両、あるいは、歩行者と自車両とが衝突する可能性が有ると判定して、S40へ処理を進める。   In S30, it is determined whether or not the specified line-of-sight direction is directed in the direction in which the host vehicle exists. If the determination is affirmative, the process proceeds to S10 and the above-described process is repeated. On the other hand, if a negative determination is made, it is determined that there is a possibility that the bicycle or other vehicle driven by the driver who does not turn his / her line of sight in the direction where the own vehicle exists, or the pedestrian and the own vehicle may collide. Then, the process proceeds to S40.

S40では、自車両から警報を発生して、自車両の位置する方向へ視線を向けていない歩行者、自転車の運転者、あるいは、他車両の運転者に対して注意を喚起する。   In S40, an alarm is generated from the host vehicle to alert a pedestrian, a bicycle driver, or a driver of another vehicle who is not looking in the direction in which the host vehicle is located.

このように、本実施形態における運転支援装置200は、自車両周囲に存在する歩行者、自転車等の軽車両の運転者、他車両の運転者の視線方向を特定し、その視線方向が自車両の存在する方向に向けられていない場合、その視線を自車両に向けていない運転者の運転する自転車や他車両、あるいは、歩行者と衝突する可能性があると判定する。これにより、自車両との衝突可能性を的確に判定することができる。   As described above, the driving support device 200 according to the present embodiment specifies the line-of-sight direction of a pedestrian, a driver of a light vehicle such as a bicycle, and the driver of another vehicle existing around the own vehicle, and the line-of-sight direction is the own vehicle. If it is not directed in the direction in which the vehicle exists, it is determined that there is a possibility of collision with a bicycle or other vehicle or a pedestrian driven by a driver who does not turn his / her line of sight toward the host vehicle. Thereby, the possibility of collision with the host vehicle can be accurately determined.

(変形例1)
本実施形態では、図4に示したS30において、自車両の位置する方向へ視線を向けていない運転者の運転する自転車や他車両、あるいは、歩行者と自車両とが衝突する可能性があると判定する場合、S40において警報を発生する処理を実行しているが、さらに、自車両の走行に制限を加えるようにしてもよい。
(Modification 1)
In this embodiment, in S30 shown in FIG. 4, there is a possibility that a bicycle or other vehicle driven by a driver who does not turn his / her line of sight in the direction in which the host vehicle is located, or a pedestrian and the host vehicle collide. When the determination is made, a process for generating an alarm is executed in S40, but a limit may be imposed on the traveling of the host vehicle.

例えば、図5に示すS50にて、自車両のアクセルペダルの開閉操作について、開側への操作が無効となる制限を加えるようにしてもよい。あるいは、自車両が加速しないように制限を加えるようにしてもよい。これにより、衝突する可能性の有る歩行者、運転者の運転する自転車や他車両に接近する時間を遅らせることができる。その結果、自車両に視線を向けていない歩行者や運転者に対して自車両の存在を気付かせるまでの時間を長くすることができる。なお、図5に示すS10〜S40の処理は、本実施形態において説明した処理と同様であるので、その説明は省略する。   For example, in S50 shown in FIG. 5, the opening / closing operation of the accelerator pedal of the host vehicle may be restricted so that the operation to the opening side becomes invalid. Or you may make it add a restriction | limiting so that the own vehicle may not accelerate. Thereby, the time which approaches the pedestrian who may collide, the bicycle which a driver drives, and other vehicles can be delayed. As a result, it is possible to lengthen the time until the pedestrian or driver who is not looking at the own vehicle notices the presence of the own vehicle. Note that the processing of S10 to S40 shown in FIG. 5 is the same as the processing described in the present embodiment, and thus the description thereof is omitted.

(変形例2)
自車両の走行に制限を加える手段として、例えば、ブレーキ駆動器100を駆動して自動制動を行うものであってもよい。これにより、自車両に視線を向けていない歩行者、運転者の運転する自転車や他車両と衝突する可能性を低くすることができる。
(Modification 2)
As a means for limiting the travel of the host vehicle, for example, the brake driver 100 may be driven to perform automatic braking. Thereby, it is possible to reduce the possibility of collision with a pedestrian who is not looking at the own vehicle, a bicycle driven by the driver, or another vehicle.

(変形例3)
本実施形態の運転支援装置200は、モータを動力源として駆動する車両に適用するとよい。すなわち、モータを動力源として駆動するハイブリッド車、電気自動車、燃料電池車等は、従来のエンジンを動力源として駆動する車両に比べ、走行時の騒音が低い。そのため、歩行者や自転車の運転者は、車両の接近に気付き難くなる。
(Modification 3)
The driving support device 200 of the present embodiment may be applied to a vehicle that drives using a motor as a power source. That is, a hybrid vehicle, an electric vehicle, a fuel cell vehicle, and the like that drive using a motor as a power source have lower noise during traveling than a vehicle that uses a conventional engine as a power source. Therefore, it is difficult for pedestrians and bicycle drivers to notice the approach of the vehicle.

従って、本実施形態の運転支援装置200をモータを動力源として駆動する車両に適用することで、自車両に視線を向けていない歩行者、運転者の運転する自転車や他車両との衝突可能性の有無を判定することができる。   Therefore, by applying the driving support device 200 of the present embodiment to a vehicle that drives using a motor as a power source, there is a possibility of collision with a pedestrian who is not looking at the own vehicle, a bicycle driven by the driver, or another vehicle. The presence or absence of can be determined.

本発明の実施形態に係わる、運転支援装置200の全体構成を示すブロック図である。It is a block diagram which shows the whole structure of the driving assistance apparatus 200 concerning embodiment of this invention. 本発明の実施形態に係わる、コンピュータ80の制御ブロック図である。It is a control block diagram of the computer 80 concerning the embodiment of the present invention. 本発明の実施形態に係わる、自車両周辺を撮影した画像のイメージ図である。It is an image figure of the image which image | photographed the surroundings of the own vehicle based on embodiment of this invention. 本発明の実施形態に係わる、警報発生処理の流れを示すフローチャートである。It is a flowchart which shows the flow of the alarm generation process concerning embodiment of this invention. 本発明の実施形態の変形例1に係わる、警報発生処理の流れを示すフローチャートである。It is a flowchart which shows the flow of the alarm generation process concerning the modification 1 of embodiment of this invention.

符号の説明Explanation of symbols

81 入出力部
82 物体認識部
83 衝突判定対象物抽出部
84 視線方向特定部
85 衝突可能性判定部
86 警報発生部
200 運転支援装置
DESCRIPTION OF SYMBOLS 81 Input / output part 82 Object recognition part 83 Collision determination target extraction part 84 Gaze direction specific part 85 Collision possibility judgment part 86 Alarm generation part 200 Driving support device

Claims (9)

自車両の周囲の画像を撮影する撮像手段と、
前記撮像手段の撮影した画像から、歩行者、自転車、及び、他車両の少なくとも1つを認識する認識手段と、
前記認識手段の認識する歩行者、自転車の運転者、及び、他車両の運転者の少なくとも1人の視線方向を特定する視線方向特定手段と、
前記視線方向特定手段によって特定される視線方向が前記自車両の存在する方向であるか否かを判定する視線方向判定手段と、
前記視線方向判定手段の判定結果に基づいて、前記視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つと前記自車両との衝突可能性を判定する衝突可能性判定手段とを備えることを特徴とする衝突可能性判定装置。
Imaging means for capturing an image of the surroundings of the host vehicle;
Recognizing means for recognizing at least one of a pedestrian, a bicycle, and another vehicle from an image taken by the imaging means;
Gaze direction identifying means for identifying the gaze direction of at least one of a pedestrian, a bicycle driver, and a driver of another vehicle recognized by the recognition means;
Gaze direction determining means for determining whether or not the gaze direction specified by the gaze direction specifying means is a direction in which the host vehicle exists;
Based on the determination result of the line-of-sight direction determination means, the possibility of a collision between the own vehicle and at least one of a pedestrian who has specified the line-of-sight direction, a bicycle driven by the driver, and another vehicle driven by the driver. A collision possibility judging device comprising: a collision possibility judging means for judging.
前記視線方向特定手段は、前記撮像手段の撮影した画像から人の顔を特徴付ける特徴点を抽出する特徴点抽出手段を備え、この特徴点抽出手段によって抽出される前記歩行者、及び前記自転車の運転者の少なくとも1人の顔の特徴点に基づいて、前記歩行者、及び前記自転車の運転者の少なくとも1人の顔面の向く方向を特定することで、前記歩行者、及び前記自転車の運転者の少なくとも1人の視線方向を特定することを特徴とする請求項1記載の衝突可能性判定装置。   The line-of-sight direction specifying unit includes a feature point extracting unit that extracts a feature point that characterizes a human face from an image captured by the imaging unit, and the pedestrian extracted by the feature point extracting unit and driving the bicycle. The direction of the face of at least one of the pedestrian and the driver of the bicycle is specified based on the feature points of the face of at least one of the person, so that the pedestrian and the driver of the bicycle The collision possibility determination device according to claim 1, wherein a gaze direction of at least one person is specified. 前記他車両は、
前記他車両の運転者の視線方向を検出する他車視線方向検出手段と、
前記他車視線方向検出手段の検出する運転者の視線方向に関する情報を前記自車両へ送信する他車両通信手段とを備え、
前記自車両は、
前記他車両通信手段との通信接続を行う自車両通信手段を備え、
前記視線方向特定手段は、前記他車両の運転者の視線方向として、前記自車両通信手段の受信する前記他車両の運転者の視線方向に関する情報から特定することを特徴とする請求項1又は2記載の衝突可能性判定装置。
The other vehicle is
Other vehicle gaze direction detection means for detecting the gaze direction of the driver of the other vehicle;
And other vehicle communication means for transmitting information related to the driver's line-of-sight direction detected by the other-vehicle line-of-sight detection means to the host vehicle,
The vehicle is
Own vehicle communication means for performing communication connection with the other vehicle communication means,
The line-of-sight direction specifying means specifies the line-of-sight direction of the driver of the other vehicle from information on the line-of-sight direction of the driver of the other vehicle received by the own vehicle communication means. The collision possibility determination device described.
前記衝突可能性判定手段は、前記視線方向判定手段によって、前記視線方向特定手段の特定する視線方向が前記自車両の存在する方向でないと判定される場合に、前記視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つと前記自車両とが衝突する可能性が有ると判定することを特徴とする請求項1〜3のいずれか1項に記載の衝突可能性判定装置。   The collision possibility determining means, when the line-of-sight direction determining means determines that the line-of-sight direction specified by the line-of-sight direction specifying means is not the direction in which the host vehicle exists, the pedestrian who specified the line-of-sight direction, 4. The vehicle according to claim 1, wherein the vehicle is determined to collide with at least one of a bicycle driven by the driver and another vehicle driven by the driver. 5. The collision possibility determination device described. 前記衝突可能性判定手段によって、前記視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つと前記自車両とが衝突する可能性が有ると判定される場合、前記視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つに対して警報を発生する警報発生手段を備えることを特徴とする請求項4記載の衝突可能性判定装置。   It is determined by the collision possibility determination means that there is a possibility that the host vehicle collides with at least one of a pedestrian who has specified the line-of-sight direction, a bicycle driven by the driver, and another vehicle driven by the driver. In this case, it is provided with a warning generation means for generating a warning for at least one of the pedestrian who specified the line-of-sight direction, the bicycle driven by the driver, and the other vehicle driven by the driver. The collision possibility determination device according to claim 4. 前記衝突可能性判定手段によって、前記視線方向を特定した歩行者、運転者の運転する自転車、及び、運転者の運転する他車両の少なくとも1つと前記自車両とが衝突する可能性が有ると判定される場合、前記自車両の走行に制限を加える走行制限手段を備えることを特徴とする請求項4又は5記載の衝突可能性判定装置。   It is determined by the collision possibility determination means that there is a possibility that the host vehicle collides with at least one of a pedestrian who has identified the line-of-sight direction, a bicycle driven by the driver, and another vehicle driven by the driver. 6. The collision possibility determination device according to claim 4, further comprising travel restriction means for restricting travel of the host vehicle. 前記走行制限手段は、前記自車両のアクセルペダルの開閉操作における開側への操作を制限することを特徴とする請求項6記載の衝突可能性判定装置。   The collision possibility determination device according to claim 6, wherein the travel restriction unit restricts an operation toward an open side in an opening / closing operation of an accelerator pedal of the host vehicle. 前記自車両は、自動的に制動装置を駆動する自動制動手段を備え、
前記走行制限手段は、前記自動制動手段による自動制動を行うことを特徴とする請求項6記載の衝突可能性判定装置。
The host vehicle includes automatic braking means for automatically driving a braking device,
7. The collision possibility determination device according to claim 6, wherein the travel restriction unit performs automatic braking by the automatic braking unit.
前記請求項1〜8のいずれか1項に記載の衝突可能性判定装置は、モータを動力源として駆動する車両に適用されることを特徴とする衝突可能性判定装置。   The collision possibility determination device according to any one of claims 1 to 8 is applied to a vehicle driven by using a motor as a power source.
JP2003400186A 2003-11-28 2003-11-28 Collision possibility judgment device Expired - Fee Related JP4134891B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2003400186A JP4134891B2 (en) 2003-11-28 2003-11-28 Collision possibility judgment device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2003400186A JP4134891B2 (en) 2003-11-28 2003-11-28 Collision possibility judgment device

Publications (2)

Publication Number Publication Date
JP2005165422A true JP2005165422A (en) 2005-06-23
JP4134891B2 JP4134891B2 (en) 2008-08-20

Family

ID=34724528

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2003400186A Expired - Fee Related JP4134891B2 (en) 2003-11-28 2003-11-28 Collision possibility judgment device

Country Status (1)

Country Link
JP (1) JP4134891B2 (en)

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006268475A (en) * 2005-03-24 2006-10-05 Nippon Seiki Co Ltd Driving support device for vehicle and driving supporting method for vehicle
JP2007249757A (en) * 2006-03-17 2007-09-27 Denso It Laboratory Inc Warning device
JP2008062666A (en) * 2006-09-04 2008-03-21 Toyota Motor Corp Vehicular warning device
JP2008168684A (en) * 2007-01-09 2008-07-24 Toyota Motor Corp Device for preventing deviation from lane
US7671725B2 (en) 2006-03-24 2010-03-02 Honda Motor Co., Ltd. Vehicle surroundings monitoring apparatus, vehicle surroundings monitoring method, and vehicle surroundings monitoring program
WO2010047054A1 (en) 2008-10-20 2010-04-29 本田技研工業株式会社 Vehicle periphery monitoring apparatus
JP2011198295A (en) * 2010-03-23 2011-10-06 Denso Corp Vehicle approach warning system
JP2011248855A (en) * 2010-04-30 2011-12-08 Denso Corp Vehicle collision warning apparatus
JP2012168578A (en) * 2011-02-09 2012-09-06 Toyota Motor Corp Moving person warning device
JP2014006700A (en) * 2012-06-25 2014-01-16 Mitsubishi Motors Corp Pedestrian detection device
JP2014025963A (en) * 2012-07-24 2014-02-06 Japan Radio Co Ltd Driving simulator
JP2015032237A (en) * 2013-08-06 2015-02-16 株式会社京三製作所 Crosswalk traffic signal system
JP2015204021A (en) * 2014-04-15 2015-11-16 株式会社デンソー Visual line detection device and visual line detection method
JP2015215871A (en) * 2014-04-24 2015-12-03 本田技研工業株式会社 Object recognition device
JP2016009251A (en) * 2014-06-23 2016-01-18 エイディシーテクノロジー株式会社 Control device for vehicle
KR20170052713A (en) * 2015-11-03 2017-05-15 현대자동차주식회사 Vehicle autonomous emergency braking system and method considering pedestrian's eye
JP2018005793A (en) * 2016-07-07 2018-01-11 株式会社デンソー Pedestrian detection device and pedestrian detection method
JP2018092549A (en) * 2016-12-07 2018-06-14 株式会社オートネットワーク技術研究所 Notification device, notification system, and computer program
CN108263380A (en) * 2016-12-30 2018-07-10 现代自动车株式会社 Consider that pedestrian watches the pedestrian impact preventing mean and method of mode attentively
JP2018156176A (en) * 2017-03-15 2018-10-04 株式会社Subaru Display system in vehicle and method for controlling display system in vehicle
JP2019156087A (en) * 2018-03-12 2019-09-19 矢崎総業株式会社 On-vehicle system
DE102019204340A1 (en) 2018-03-29 2019-10-02 Honda Motor Co., Ltd. output device
JP2020533662A (en) * 2017-09-11 2020-11-19 コンティ テミック マイクロエレクトロニック ゲゼルシャフト ミット ベシュレンクテル ハフツングConti Temic microelectronic GmbH Gesture control with a simple 2D camera to communicate with autonomously driving vehicles
JP2021135693A (en) * 2020-02-26 2021-09-13 三菱ロジスネクスト株式会社 Processing device, processing method, estimation system and program
KR20220115687A (en) * 2021-02-09 2022-08-18 한양대학교 에리카산학협력단 Pedestrian communication system for self driving cars
EP3877227A4 (en) * 2018-12-14 2022-08-24 Waymo Llc Operating an autonomous vehicle according to road user reaction modeling with occlusions
CN115176058A (en) * 2020-03-19 2022-10-11 株式会社小松制作所 Work machine periphery monitoring system, work machine, and work machine periphery monitoring method

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101233657A (en) 2005-07-28 2008-07-30 松下电器产业株式会社 Laser light source and display device
US7769060B1 (en) 2005-09-14 2010-08-03 Panasonic Corporation Laser light source, and display device using the same

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08326573A (en) * 1995-06-02 1996-12-10 Aqueous Res:Kk Safety drive assisting device for vehicle
JP2001116564A (en) * 1999-10-15 2001-04-27 Toshiba Corp Mobile communication system
JP2001199296A (en) * 2000-01-17 2001-07-24 Matsushita Electric Ind Co Ltd Warning device, driver's seat having vibrating body, and mobile body equipped with warning device on vehicle
JP2001219760A (en) * 2000-02-09 2001-08-14 Hitachi Ltd Moving body driving support device
JP2002342887A (en) * 2001-05-17 2002-11-29 Honda Motor Co Ltd Mobile communication device
DE10325762A1 (en) * 2003-06-05 2004-12-23 Daimlerchrysler Ag Image processing system for a vehicle
JP2005062912A (en) * 2003-06-16 2005-03-10 Fujitsu Ten Ltd Vehicles controller

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08326573A (en) * 1995-06-02 1996-12-10 Aqueous Res:Kk Safety drive assisting device for vehicle
JP2001116564A (en) * 1999-10-15 2001-04-27 Toshiba Corp Mobile communication system
JP2001199296A (en) * 2000-01-17 2001-07-24 Matsushita Electric Ind Co Ltd Warning device, driver's seat having vibrating body, and mobile body equipped with warning device on vehicle
JP2001219760A (en) * 2000-02-09 2001-08-14 Hitachi Ltd Moving body driving support device
JP2002342887A (en) * 2001-05-17 2002-11-29 Honda Motor Co Ltd Mobile communication device
DE10325762A1 (en) * 2003-06-05 2004-12-23 Daimlerchrysler Ag Image processing system for a vehicle
JP2004362586A (en) * 2003-06-05 2004-12-24 Daimler Chrysler Ag Image processing system for vehicle
JP2005062912A (en) * 2003-06-16 2005-03-10 Fujitsu Ten Ltd Vehicles controller

Cited By (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4645891B2 (en) * 2005-03-24 2011-03-09 日本精機株式会社 Vehicle driving support apparatus and vehicle driving support method
JP2006268475A (en) * 2005-03-24 2006-10-05 Nippon Seiki Co Ltd Driving support device for vehicle and driving supporting method for vehicle
JP2007249757A (en) * 2006-03-17 2007-09-27 Denso It Laboratory Inc Warning device
US7671725B2 (en) 2006-03-24 2010-03-02 Honda Motor Co., Ltd. Vehicle surroundings monitoring apparatus, vehicle surroundings monitoring method, and vehicle surroundings monitoring program
JP2008062666A (en) * 2006-09-04 2008-03-21 Toyota Motor Corp Vehicular warning device
JP2008168684A (en) * 2007-01-09 2008-07-24 Toyota Motor Corp Device for preventing deviation from lane
WO2010047054A1 (en) 2008-10-20 2010-04-29 本田技研工業株式会社 Vehicle periphery monitoring apparatus
US8648912B2 (en) 2008-10-20 2014-02-11 Honda Motor Co., Ltd. Vehicle periphery monitoring apparatus
JP2011198295A (en) * 2010-03-23 2011-10-06 Denso Corp Vehicle approach warning system
US8514100B2 (en) 2010-03-23 2013-08-20 Denso Corporation Vehicle approach warning system
JP2011248855A (en) * 2010-04-30 2011-12-08 Denso Corp Vehicle collision warning apparatus
JP2012168578A (en) * 2011-02-09 2012-09-06 Toyota Motor Corp Moving person warning device
JP2014006700A (en) * 2012-06-25 2014-01-16 Mitsubishi Motors Corp Pedestrian detection device
JP2014025963A (en) * 2012-07-24 2014-02-06 Japan Radio Co Ltd Driving simulator
JP2015032237A (en) * 2013-08-06 2015-02-16 株式会社京三製作所 Crosswalk traffic signal system
JP2015204021A (en) * 2014-04-15 2015-11-16 株式会社デンソー Visual line detection device and visual line detection method
JP2015215871A (en) * 2014-04-24 2015-12-03 本田技研工業株式会社 Object recognition device
JP2016009251A (en) * 2014-06-23 2016-01-18 エイディシーテクノロジー株式会社 Control device for vehicle
KR20170052713A (en) * 2015-11-03 2017-05-15 현대자동차주식회사 Vehicle autonomous emergency braking system and method considering pedestrian's eye
KR102258475B1 (en) * 2015-11-03 2021-06-01 현대자동차주식회사 Vehicle autonomous emergency braking system and method considering pedestrian's eye
JP2018005793A (en) * 2016-07-07 2018-01-11 株式会社デンソー Pedestrian detection device and pedestrian detection method
WO2018008314A1 (en) * 2016-07-07 2018-01-11 株式会社デンソー Pedestrian detection device and pedestrian detection method
US20190213887A1 (en) * 2016-07-07 2019-07-11 Denso Corporation Pedestrian detection apparatus and pedestrian detection method
US11011062B2 (en) 2016-07-07 2021-05-18 Denso Corporation Pedestrian detection apparatus and pedestrian detection method
WO2018105426A1 (en) * 2016-12-07 2018-06-14 株式会社オートネットワーク技術研究所 Notification device, notification system, and computer program
JP2018092549A (en) * 2016-12-07 2018-06-14 株式会社オートネットワーク技術研究所 Notification device, notification system, and computer program
CN108263380A (en) * 2016-12-30 2018-07-10 现代自动车株式会社 Consider that pedestrian watches the pedestrian impact preventing mean and method of mode attentively
US10479202B2 (en) 2017-03-15 2019-11-19 Subaru Corporation Vehicle display system and method of controlling vehicle display system
JP2018156176A (en) * 2017-03-15 2018-10-04 株式会社Subaru Display system in vehicle and method for controlling display system in vehicle
CN108621941A (en) * 2017-03-15 2018-10-09 株式会社斯巴鲁 The control method of the display system of vehicle and the display system of vehicle
US11557150B2 (en) 2017-09-11 2023-01-17 Conti Temic Microelectronic Gmbh Gesture control for communication with an autonomous vehicle on the basis of a simple 2D camera
JP2020533662A (en) * 2017-09-11 2020-11-19 コンティ テミック マイクロエレクトロニック ゲゼルシャフト ミット ベシュレンクテル ハフツングConti Temic microelectronic GmbH Gesture control with a simple 2D camera to communicate with autonomously driving vehicles
JP7280865B2 (en) 2017-09-11 2023-05-24 コンティ テミック マイクロエレクトロニック ゲゼルシャフト ミット ベシュレンクテル ハフツング Gesture control employing a simple 2D camera to communicate with an autonomously driving vehicle
WO2019176310A1 (en) * 2018-03-12 2019-09-19 矢崎総業株式会社 On-vehicle system
JP2019156087A (en) * 2018-03-12 2019-09-19 矢崎総業株式会社 On-vehicle system
US10818174B2 (en) 2018-03-29 2020-10-27 Honda Motor Co., Ltd. Output apparatus
DE102019204340A1 (en) 2018-03-29 2019-10-02 Honda Motor Co., Ltd. output device
DE102019204340B4 (en) 2018-03-29 2024-03-21 Honda Motor Co., Ltd. Dispensing device
CN110319848A (en) * 2018-03-29 2019-10-11 本田技研工业株式会社 Output device
CN110319848B (en) * 2018-03-29 2023-03-14 本田技研工业株式会社 Output device
US11619940B2 (en) 2018-12-14 2023-04-04 Waymo Llc Operating an autonomous vehicle according to road user reaction modeling with occlusions
EP3877227A4 (en) * 2018-12-14 2022-08-24 Waymo Llc Operating an autonomous vehicle according to road user reaction modeling with occlusions
JP7267221B2 (en) 2020-02-26 2023-05-01 三菱ロジスネクスト株式会社 Processing device, processing method, estimation system and program
JP2021135693A (en) * 2020-02-26 2021-09-13 三菱ロジスネクスト株式会社 Processing device, processing method, estimation system and program
CN115176058A (en) * 2020-03-19 2022-10-11 株式会社小松制作所 Work machine periphery monitoring system, work machine, and work machine periphery monitoring method
KR20220115687A (en) * 2021-02-09 2022-08-18 한양대학교 에리카산학협력단 Pedestrian communication system for self driving cars
KR102568283B1 (en) 2021-02-09 2023-08-21 한양대학교 에리카산학협력단 Pedestrian communication system for self driving cars

Also Published As

Publication number Publication date
JP4134891B2 (en) 2008-08-20

Similar Documents

Publication Publication Date Title
JP4134891B2 (en) Collision possibility judgment device
JP6617534B2 (en) Driving assistance device
KR101750178B1 (en) Warning Method Outside Vehicle, Driver Assistance Apparatus For Executing Method Thereof and Vehicle Having The Same
US10286905B2 (en) Driver assistance apparatus and control method for the same
KR101838187B1 (en) Display Apparatus and Vehicle Having The Same
JP3102250B2 (en) Ambient information display device for vehicles
JP4807263B2 (en) Vehicle display device
EP3211616A2 (en) Driver assistance apparatus
WO2017119170A1 (en) Driving assistance device
KR20170058188A (en) Driver Assistance Apparatus and Vehicle Having The Same
JP2010030513A (en) Driving support apparatus for vehicle
WO2018146961A1 (en) Vehicle display control device
JP2006227811A (en) Driving support apparatus
US10045173B1 (en) Vehicle outside notification device
JP3941770B2 (en) Collision possibility judgment device
KR101962348B1 (en) Driver Assistance Apparatus and Vehicle Having The Same
JP2010113601A (en) Vehicle warning apparatus
JP2020177292A (en) Vehicle remote indication system
WO2020031695A1 (en) Information processing device, mobile body, information processing method, and program
JP2020033013A (en) Drive assist system
JP4277678B2 (en) Vehicle driving support device
CN113401056A (en) Display control device, display control method, and computer-readable storage medium
EP4102323B1 (en) Vehicle remote control device, vehicle remote control system, vehicle remote control method, and vehicle remote control program
WO2017138343A1 (en) Driving teaching device
JP7302311B2 (en) Vehicle display control device, vehicle display control method, vehicle display control program

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20060130

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20080205

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20080304

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20080326

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20080507

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20080520

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110613

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110613

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120613

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120613

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130613

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140613

Year of fee payment: 6

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees