JP2021089470A - Periphery monitoring system - Google Patents

Periphery monitoring system Download PDF

Info

Publication number
JP2021089470A
JP2021089470A JP2019218018A JP2019218018A JP2021089470A JP 2021089470 A JP2021089470 A JP 2021089470A JP 2019218018 A JP2019218018 A JP 2019218018A JP 2019218018 A JP2019218018 A JP 2019218018A JP 2021089470 A JP2021089470 A JP 2021089470A
Authority
JP
Japan
Prior art keywords
vehicle
information
monitoring system
gaze
driver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2019218018A
Other languages
Japanese (ja)
Other versions
JP7466985B2 (en
Inventor
浩美 渡邊
Hiromi Watanabe
浩美 渡邊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alpine Electronics Inc
Original Assignee
Alpine Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alpine Electronics Inc filed Critical Alpine Electronics Inc
Priority to JP2019218018A priority Critical patent/JP7466985B2/en
Publication of JP2021089470A publication Critical patent/JP2021089470A/en
Application granted granted Critical
Publication of JP7466985B2 publication Critical patent/JP7466985B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Traffic Control Systems (AREA)

Abstract

To provide a periphery monitoring system for presenting other-vehicle information in which a driver is actually interested.SOLUTION: An other-vehicle recognition device 3 analyzes images of a periphery captured by cameras 1 and a position of an object in the periphery detected by radars 2, so as to recognize another vehicle in the periphery of an automobile. A DMS 8 detects a position of a view point and gazing direction of a driver. A control device 4 sets an interest level of a driver with respect to the other vehicle based on a frequency of gazing at the other vehicle by a driver and a total gazing time, does not present other-vehicle information by a sound output concerning the other vehicle of other-vehicle data where an interest level is set to be lower, performs a notification of occurrence of a behavior related to an own vehicle as presentation of other-vehicle information by a sound output concerning the other vehicle where an interest level is set to be middle, and performs a notification of whole behaviors that have occurred by a behavior change by a sound output concerning the other vehicle of other-vehicle data where an interest level is set to be higher.SELECTED DRAWING: Figure 6

Description

本発明は、自動車周辺の他車の情報を提示する技術に関するものである。 The present invention relates to a technique for presenting information on other vehicles around an automobile.

自動車周辺の他車の情報を提示する技術としては、自動車周辺の他車の監視を行うシステムにおいて、ユーザが指定した他車や危険走行している他車を危険車両に設定して、危険車両の識別情報を記憶しておき、その後、危険車両の情報をドライバーに対して通知する技術が知られている(たとえば、特許文献1)。 As a technology for presenting information on other vehicles around the vehicle, in a system for monitoring other vehicles around the vehicle, another vehicle specified by the user or another vehicle running dangerously is set as a dangerous vehicle, and the vehicle is dangerous. There is known a technique of storing the identification information of the vehicle and then notifying the driver of the information of the dangerous vehicle (for example, Patent Document 1).

特開2016-76030号公報Japanese Unexamined Patent Publication No. 2016-76030

上述した技術によれば、ユーザが指定した他車を危険車両として設定する場合には、一々、危険車両として設定する他車をドライバーが指定する操作を行う必要があるため煩雑であり、危険走行している他車を自動的に危険車両に設定する場合には、危険車両に自動設定された他車以外の他車にドライバーが関心を持っていても、その他車の情報は提示されないこととなる。 According to the above-mentioned technology, when setting another vehicle designated by the user as a dangerous vehicle, it is complicated and dangerous driving because it is necessary for the driver to perform an operation for designating the other vehicle to be set as a dangerous vehicle one by one. When the other vehicle is automatically set as a dangerous vehicle, even if the driver is interested in another vehicle other than the other vehicle automatically set as a dangerous vehicle, the information of the other vehicle will not be presented. Become.

また、他車毎に、ドライバーが他車に持つ関心の強さは異なり、関心を強さに応じて、ドライバーが知得することを望む他車の情報の内容も異なる。しかし、上述した技術では、他車の情報として、ドライバーの関心の強さに応じた適切な内容の情報を提示することはできない。 In addition, the strength of interest that the driver has in other vehicles differs for each other vehicle, and the content of information on other vehicles that the driver wants to know also differs depending on the strength of interest. However, with the above-mentioned technology, it is not possible to present appropriate information according to the strength of interest of the driver as information on other vehicles.

そこで、本発明は、ドライバーに煩雑な作業を課すことなく、ドライバーに当該ドライバーが真に関心をもっている他車の情報を提示することを課題とする。
また、併せて本発明は、ドライバーが関心をもっている他車の情報として、当該関心の強さに適した内容の情報をドライバーに提示することを課題とする。
Therefore, it is an object of the present invention to present to the driver information on another vehicle in which the driver is really interested, without imposing complicated work on the driver.
At the same time, it is an object of the present invention to present to the driver information of contents suitable for the strength of the interest as information of another vehicle in which the driver is interested.

前記課題達成のために、本発明は、自動車周辺の他車の情報を提示する周辺監視システムに、前記自動車周辺の他車を認識する他車認識手段と、前記自動車のドライバーの前記自動車周辺の他車の注視状況を検出する注視状況検出手段と、前記他車認識手段が認識した他車の情報を前記ドライバーに提示する他車情報提示手段とを備えたものである。ただし、前記他車情報提示手段は、前記他車認識手段が認識した他車のうち、前記注視状況検出手段が検出している注視状況が表すドライバーが注視している程度である注視程度が所定のレベルより大きい他車を監視対象他車に設定し、継続的に前記監視対象他車の情報を提示するものである。 In order to achieve the above object, the present invention provides a peripheral monitoring system that presents information on other vehicles around the vehicle, a vehicle recognition means for recognizing other vehicles around the vehicle, and a driver of the vehicle around the vehicle. It is provided with a gaze status detecting means for detecting the gaze status of another vehicle and another vehicle information presenting means for presenting information on the other vehicle recognized by the other vehicle recognizing means to the driver. However, the other vehicle information presenting means has a predetermined degree of gaze, which is the degree to which the driver representing the gaze status detected by the gaze status detection means is gazing among the other vehicles recognized by the other vehicle recognition means. The other vehicle larger than the above level is set as the monitored other vehicle, and the information of the monitored other vehicle is continuously presented.

ここで、このような周辺監視システムは、前記他車情報提示手段において、監視対象他車の情報の提示を当該情報を表す音声出力により行うと共に、前記他車認識手段が認識した他車のうちの監視対象他車でない他車の情報の音声出力による提示は行わないように構成してもよい。 Here, such a peripheral monitoring system presents the information of the other vehicle to be monitored by the voice output representing the information in the other vehicle information presenting means, and among the other vehicles recognized by the other vehicle recognition means. It may be configured not to present the information of another vehicle other than the other vehicle to be monitored by voice output.

また、このような周辺監視システムは、前記他車認識手段において、前記自動車周辺の他車の挙動を検出し、前記他車情報提示手段において、前記他車認識手段が検出している前記監視対象他車の所定の挙動が発生したときに、当該挙動の発生を当該監視対象他車の情報として提示するように構成してもよい。 In addition, such a peripheral monitoring system detects the behavior of another vehicle around the vehicle in the other vehicle recognition means, and the monitoring target detected by the other vehicle recognition means in the other vehicle information presenting means. When a predetermined behavior of another vehicle occurs, the occurrence of the behavior may be presented as information of the other vehicle to be monitored.

このような周辺監視システムによれば、ドライバーが注視している程度が大きい他車を自動的に監視対象他車に設定して、その情報を提示する。ここで、ドライバーが注視している程度が大きい他車は、ドライバーが関心を示している他車であるので、本周辺監視システムによれば、ドライバーの煩雑な操作を必要とすることなく、ドライバーが真に関心をもっている他車の情報をドライバーに提示することができる。 According to such a peripheral monitoring system, another vehicle that the driver is paying close attention to is automatically set as the other vehicle to be monitored, and the information is presented. Here, the other vehicle that the driver is paying close attention to is the other vehicle that the driver is interested in. Therefore, according to this peripheral monitoring system, the driver does not need to perform complicated operations. Can present information to the driver about other vehicles that he is really interested in.

また、本発明は、前記課題達成のために、自動車周辺の他車の情報を提示する周辺監視システムに、前記自動車周辺の他車を認識する他車認識手段と、前記自動車のドライバーの前記自動車周辺の他車の注視状況を検出する注視状況検出手段と、前記他車認識手段が認識した他車の情報を前記ドライバーに提示する他車情報提示手段とを備えたものである。ただし、前記他車情報提示手段は、前記他車認識手段が認識した他車のうち、前記注視状況検出手段が検出している注視状況が表すドライバーが注視している程度である注視程度が所定のレベルである第1レベルより大きい他車の情報を、前記注視程度が前記第1レベルより大きくない他車の情報よりも、よりきめ細かく提示するものである。 Further, in order to achieve the above-mentioned problems, the present invention provides a peripheral monitoring system that presents information on other vehicles around the vehicle, another vehicle recognition means for recognizing other vehicles around the vehicle, and the vehicle of the driver of the vehicle. It is provided with a gaze status detecting means for detecting the gaze status of other vehicles in the vicinity and another vehicle information presenting means for presenting information on the other vehicle recognized by the other vehicle recognizing means to the driver. However, the other vehicle information presenting means has a predetermined degree of gaze, which is the degree to which the driver representing the gaze status detected by the gaze status detection means is gazing among the other vehicles recognized by the other vehicle recognition means. Information on other vehicles that is larger than the first level, which is the level of the above, is presented in more detail than information on other vehicles whose gaze level is not greater than the first level.

ここで、このような周辺監視システムは、前記他車情報提示手段において、前記他車認識手段が認識した他車のうち、前記注視程度が前記第1レベルより小さいレベルである第2レベルより大きい他車の情報を提示すると共に、前記注視程度が前記第1レベルより大きい他車の情報を、前記注視程度が前記第2レベルより大きく前記第1レベルより大きくない他車の情報よりも、よりきめ細かく提示するように構成してもよい。 Here, such a peripheral monitoring system is larger than the second level in which the gaze level is smaller than the first level among the other vehicles recognized by the other vehicle recognition means in the other vehicle information presenting means. In addition to presenting information on other vehicles, information on other vehicles whose gaze level is greater than the first level is more than information on other vehicles whose gaze level is greater than the second level and not greater than the first level. It may be configured to be presented in detail.

また、この場合には、前記他車情報提示手段において、他車の情報の提示を当該情報を表す音声出力により行うと共に、前記注視程度が前記第2レベルより大きくない他車の情報の音声出力による提示は行わないようにしてもよい。 Further, in this case, the other vehicle information presenting means presents the information of the other vehicle by the voice output representing the information, and also outputs the information of the other vehicle whose gaze level is not larger than the second level. It may not be presented by.

また、さらに、前記他車認識手段において、前記自動車周辺の他車の挙動を検出し、前記他車情報提示手段において、前記他車認識手段が認識した他車のうち、前記注視程度が前記第2レベルより大きく前記第1レベルより大きくない他車の予め第1グループに分類した挙動が発生したときに、当該挙動の発生を当該他車の情報として音声出力により提示し、前記注視程度が前記第1レベルより大きい他車の前記第1グループに分類した挙動と予め第2グループに分類した挙動のいずれかが発生したときに、当該挙動の発生を当該他車の情報として音声出力により提示するようにしてもよい。ただし、前記第1グループに分類された挙動と、前記第2グループに分類された挙動とは異なるものである。 Further, the other vehicle recognition means detects the behavior of another vehicle around the vehicle, and the other vehicle information presenting means recognizes the other vehicle by the other vehicle recognition means. When the behavior of another vehicle that is larger than the 2nd level and not larger than the 1st level occurs in advance in the first group, the occurrence of the behavior is presented as information of the other vehicle by voice output, and the degree of gaze is described as described above. When either the behavior classified into the first group of another vehicle larger than the first level or the behavior classified into the second group in advance occurs, the occurrence of the behavior is presented as information of the other vehicle by voice output. You may do so. However, the behavior classified into the first group and the behavior classified into the second group are different.

ここで、以上の周辺監視システムにおいて、前記他車情報提示手段は、前記注視程度を、注視した回数が大きくなるほど大きくなり、注視した期間の時間長が大きくなるほど大きくなるように算定してもよい。 Here, in the above peripheral monitoring system, the other vehicle information presenting means may calculate the degree of gaze so that it increases as the number of gazes increases and increases as the time length of the gaze period increases. ..

このような周辺監視システムによれば、ドライバーが注視している程度が大きい他車を自動的に抽出して、その情報を提示する。ここで、ドライバーが注視している程度が大きい他車は、ドライバーが関心を示している他車であるので、本周辺監視システムによれば、ドライバーの煩雑な操作を必要とすることなく、ドライバーが真に関心をもっている他車の情報を、ドライバーに提示することができる。また、注視している程度が大きい他車、すなわち、ドライバーが関心を示している程度が大きい他車ほど、よりきめ細かく、その情報を提示するので、ドライバーの関心の強さに適した内容の情報をドライバーに提示することができる。 According to such a peripheral monitoring system, other vehicles that the driver is paying close attention to are automatically extracted and the information is presented. Here, the other vehicle that the driver is paying close attention to is the other vehicle that the driver is interested in. Therefore, according to this peripheral monitoring system, the driver does not need to perform complicated operations. Can present information to the driver about other vehicles that he is really interested in. In addition, other vehicles that are more closely watched, that is, other vehicles that the driver is more interested in, present the information in more detail, so the information is suitable for the strength of the driver's interest. Can be presented to the driver.

また、前記課題達成のために、本発明は、自動車周辺の他車の情報を提示する周辺監視システムに、前記自動車周辺の他車を認識する他車認識手段と、前記自動車のドライバーの前記自動車周辺の他車に関心を払う行動の発生を検出する行動検出手段と、前記他車認識手段が認識した他車の情報を前記ドライバーに提示する他車情報提示手段とを設けたものである。ただし、前記他車情報提示手段は、前記他車認識手段が認識した他車のうち、前記行動検出手段が当該他車に対する関心を払う行動の発生を検出した他車を監視対象他車に設定し、継続的に前記監視対象他車の情報を提示するものである。 Further, in order to achieve the above-mentioned problems, the present invention provides a peripheral monitoring system that presents information on other vehicles around the vehicle, a vehicle recognition means for recognizing other vehicles around the vehicle, and the vehicle of the driver of the vehicle. An action detecting means for detecting the occurrence of an action of paying attention to another vehicle in the vicinity and another vehicle information presenting means for presenting information on the other vehicle recognized by the other vehicle recognizing means to the driver are provided. However, the other vehicle information presenting means sets the other vehicle recognized by the other vehicle recognition means as the other vehicle to be monitored when the behavior detection means detects the occurrence of an action that pays attention to the other vehicle. Then, the information of the other vehicle to be monitored is continuously presented.

ここで、こような周辺監視システムにおいて、前記行動検出手段が検出する他車に関心を払う行動は、少なくとも他車を指さす行動を含むことが好ましい。
このような周辺監視システムによっても、ドライバーの煩雑な操作を必要とすることなく、ドライバーが真に関心をもっている他車の情報をドライバーに提示することができる。
Here, in such a peripheral monitoring system, it is preferable that the action of paying attention to the other vehicle detected by the action detecting means includes at least the action of pointing to the other vehicle.
Even with such a peripheral monitoring system, it is possible to present information on other vehicles that the driver is really interested in to the driver without requiring complicated operations by the driver.

以上のように、本発明によれば、ドライバーに煩雑な作業を課すことなく、ドライバーに当該ドライバーが真に関心をもっている他車の情報を提示することができる。
また、本発明によれば、ドライバーが関心をもっている他車の情報として、当該関心の強さに適した内容の情報をドライバーに提示することができる。
As described above, according to the present invention, it is possible to present the driver with information on another vehicle in which the driver is really interested, without imposing complicated work on the driver.
Further, according to the present invention, as information on other vehicles that the driver is interested in, it is possible to present the driver with information that is suitable for the strength of the interest.

本発明の実施形態に係る周辺監視システムの構成を示すブロック図である。It is a block diagram which shows the structure of the peripheral monitoring system which concerns on embodiment of this invention. 本発明の実施形態に係る周辺監視システムの配置を示す図である。It is a figure which shows the arrangement of the peripheral monitoring system which concerns on embodiment of this invention. 本発明の実施形態に係る他車管理テーブルを示す図である。It is a figure which shows the other vehicle management table which concerns on embodiment of this invention. 本発明の実施形態に係る関心度設定処理を示すフローチャートである。It is a flowchart which shows the interest degree setting process which concerns on embodiment of this invention. 本発明の実施形態に係る他車提示画像の表示例を示す図である。It is a figure which shows the display example of the other vehicle presentation image which concerns on embodiment of this invention. 本発明の実施形態に係る他車情報提示のルールを示す図である。It is a figure which shows the rule of the other vehicle information presentation which concerns on embodiment of this invention.

以下、本発明の実施形態について説明する。
図1に、本実施形態に係る周辺監視システムの構成を示す。
周辺監視システムは自動車に搭載されるシステムであり、複数のカメラ1と、複数のレーダ2と、他車認識装置3と、制御装置4と、ディスプレイ5と、スピーカを用いて音声を出力する音声出力装置6と、音声認識を行って音声入力を受け付ける音声入力装置7と、DMS8(ドライバーモニタリングシステム8)と、他車管理テーブル9とを備えている。
Hereinafter, embodiments of the present invention will be described.
FIG. 1 shows the configuration of the peripheral monitoring system according to the present embodiment.
The peripheral monitoring system is a system mounted on an automobile, and is a voice that outputs voice using a plurality of cameras 1, a plurality of radars 2, another vehicle recognition device 3, a control device 4, a display 5, and a speaker. It includes an output device 6, a voice input device 7 that performs voice recognition and accepts voice input, a DMS 8 (driver monitoring system 8), and another vehicle management table 9.

ここで、ディスプレイ5は、たとえば、図2aに示すように、ドライバーから視認可能なように、自動車のダッシュボードに配置されている。
また、DMS8は、図2bに示すように、自動車室内に配置された、運転席に着座したドライバーの頭部をドライバーの前方より撮影する赤外線カメラ81で撮影した映像等から、ドライバーの視点の位置や注視方向(見ている方向)や、その他のドライバーの挙動を検出する。
Here, the display 5 is arranged on the dashboard of the automobile so as to be visible to the driver, for example, as shown in FIG. 2a.
Further, as shown in FIG. 2b, the DMS 8 is the position of the driver's viewpoint from an image taken by an infrared camera 81, which is arranged in the vehicle interior and captures the head of the driver seated in the driver's seat from the front of the driver. And the gaze direction (viewing direction) and other driver behaviors are detected.

また、複数のカメラ1とレーダ2は、たとえば、図2cに示すように、各カメラ1によって全方位の自動車の周辺を撮影でき、各レーダ2によって全方位の自動車の周辺の物体の位置を検出できるように配置されている。 Further, as shown in FIG. 2c, the plurality of cameras 1 and the radar 2 can photograph the periphery of the automobile in all directions by each camera 1, and each radar 2 detects the position of an object around the automobile in all directions. It is arranged so that it can be done.

そして、他車認識装置3は、カメラ1で撮影した周辺の映像やレーダ2で検出した周辺の物体の位置を解析して、自動車の周辺の他車の位置や車種や色や登録番号などを識別し、他車情報として制御装置4に出力する。 Then, the other vehicle recognition device 3 analyzes the position of the surrounding object captured by the camera 1 and the position of the surrounding object detected by the radar 2, and obtains the position, vehicle type, color, registration number, etc. of the other vehicle around the vehicle. It is identified and output to the control device 4 as other vehicle information.

次に、他車管理テーブル9には、図3に示すように、他車認識装置3が認識した他車毎に設けた他車データが登録される。
各他車データには、他車の識別を表す他車ID、他車の色、他車の車種、他車の登録番号(他車のナンバープレートの番号)、ドライバーの他車に対する関心の度合いを表す関心度、他車の位置の履歴を表す位置履歴、ドライバーが他車を注視した履歴を表す注視履歴、他車のその他の属性が登録される。
Next, as shown in FIG. 3, other vehicle data provided for each other vehicle recognized by the other vehicle recognition device 3 is registered in the other vehicle management table 9.
In each other vehicle data, the other vehicle ID indicating the identification of the other vehicle, the color of the other vehicle, the model of the other vehicle, the registration number of the other vehicle (the license plate number of the other vehicle), and the degree of interest of the driver in the other vehicle The degree of interest that represents, the position history that represents the history of the position of the other vehicle, the gaze history that represents the history of the driver gazing at the other vehicle, and other attributes of the other vehicle are registered.

制御装置4は、他車認識装置3から他車情報を受け取ったならば、他車管理テーブル更新処理を行う。
他車管理テーブル更新処理では、受け取った他車情報と整合する他車データを対象他車データとして、受け取った他車情報が表す位置を現時刻と共に対象他車データの位置履歴に追加登録する。他車情報と整合する他車データとは、他車情報の色や車種や登録番号や位置と、登録されている色や車種や登録番号や位置履歴が、同一車両の情報として矛盾せずに整合する他車データである。
When the control device 4 receives the other vehicle information from the other vehicle recognition device 3, the control device 4 performs the other vehicle management table update process.
In the other vehicle management table update process, the other vehicle data consistent with the received other vehicle information is used as the target other vehicle data, and the position represented by the received other vehicle information is additionally registered in the position history of the target other vehicle data together with the current time. Other vehicle data that is consistent with other vehicle information means that the color, vehicle type, registration number, and position of the other vehicle information and the registered color, vehicle type, registration number, and position history are consistent as the same vehicle information. It is the data of other vehicles that match.

また、他車管理テーブル更新処理では、他車認識装置3から受け取った他車情報に整合する他車データが存在しない場合には、新たな他車データを作成し、作成した他車データに、固有の他車ID、受け取った他車情報の色、車種、登録番号を登録する。そして、作成した他車データを対象他車データとして、受け取った他車情報が表す位置を現時刻と共に対象他車データの位置履歴に登録する。また、作成した他車データの関心度に初期値として小を設定する。 In the other vehicle management table update process, if there is no other vehicle data that matches the other vehicle information received from the other vehicle recognition device 3, new other vehicle data is created and the created other vehicle data is added to the created other vehicle data. Register the unique other vehicle ID, the color of the received other vehicle information, the vehicle type, and the registration number. Then, the created other vehicle data is used as the target other vehicle data, and the position represented by the received other vehicle information is registered in the position history of the target other vehicle data together with the current time. In addition, a small value is set as the initial value for the degree of interest of the created other vehicle data.

また、制御装置4は、図4に示す関心度設定処理を行って、他車管理テーブル9の各他車データに関心度を設定する。
図示するように、関心度設定処理では、DMS8が検出しているドライバーの視点と注視方向から、ドライバーがいずれかの他車を注視しているかどうかを、各他車データの位置履歴を参照して監視する(ステップ402)。
Further, the control device 4 performs the interest level setting process shown in FIG. 4 to set the interest level in each other vehicle data of the other vehicle management table 9.
As shown in the figure, in the interest level setting process, the position history of each other vehicle data is referred to to determine whether or not the driver is gazing at any of the other vehicles from the driver's viewpoint and gaze direction detected by the DMS8. And monitor (step 402).

ここで、ステップ402では、他車データの位置履歴中の最新の位置の時刻が、現時点から過去所定時間長(たとえば、0.5秒)内の時刻であるときに、当該最新の位置、もしくは、位置履歴から推定される現在の他車の位置を、当該他車データの他車の現在位置とする。一方、他車データの位置履歴が示す最新の位置の時刻が、現時点から所定期間内でないときには、当該他車データの現在位置は不明とする。 Here, in step 402, when the time of the latest position in the position history of the other vehicle data is within the past predetermined time length (for example, 0.5 seconds) from the present time, the latest position or the time is , The current position of the other vehicle estimated from the position history is set as the current position of the other vehicle in the other vehicle data. On the other hand, when the time of the latest position indicated by the position history of the other vehicle data is not within the predetermined period from the present time, the current position of the other vehicle data is unknown.

そして、DMS8が検出しているドライバーの視点と注視方向から求まるドライバが見ている方向に、現在位置がある他車が存在するときに、ドライバーが他車を注視していると判定する。また、当該ドライバが見ている方向に現在位置がある他車をドライバーが注視している他車とする。 Then, when there is another vehicle having the current position in the direction that the driver is looking at, which is obtained from the driver's viewpoint and the gaze direction detected by the DMS 8, it is determined that the driver is gaze at the other vehicle. In addition, another vehicle whose current position is in the direction in which the driver is looking is regarded as another vehicle in which the driver is watching.

ここで、他車の注視には、ルームミラーやサイドミラー越しの他車の注視も含む。また、この場合、ドライバーがルームミラーやサイドミラー越しに見ている方向は、DMS8が検出しているドライバーの視点とルームミラーやサイドミラーとの位置関係と、ルームミラーやサイドミラーの特性と、DMS8が検出しているドライバーの注視方向とから求める。 Here, the gaze of other vehicles includes the gaze of other vehicles through the rearview mirrors and side mirrors. Further, in this case, the direction in which the driver is looking through the rearview mirror or the side mirror is the positional relationship between the driver's viewpoint detected by the DMS8 and the rearview mirror or the side mirror, and the characteristics of the rearview mirror or the side mirror. It is obtained from the gaze direction of the driver detected by the DMS8.

そして、他車の注視が発生したならば(ステップ402)、他車の注視が終了するのを待って(ステップ404)、他車の注視を継続していた時間である注視時間を算定し(ステップ406)、算定した注視時間を現時刻と共に、注視していた他車データの注視履歴に追加登録する(ステップ408)。 Then, if gaze of another vehicle occurs (step 402), wait for the gaze of the other vehicle to be completed (step 404), and calculate the gaze time, which is the time during which the gaze of the other vehicle was continued (step 404). Step 406), the calculated gaze time is additionally registered in the gaze history of the other vehicle data that was being gazed together with the current time (step 408).

そして、注視していた他車データの注視履歴から、注目度DAを算定する(ステップ410)。
ステップ410では、注視していた他車データの注視履歴が示す過去所定期間中に、当該他車を注視した回数をN、注視していた他車データの注視履歴が示す、過去所定期間中に当該他車を注視した時間の合計をTとして、Nが大きくなるほど大きくなり、Tが大きくなるほど大きくなるように注目度DAを算出する。すなわち、たとえば、DA=N×Tや、k1、k2を所定の係数として、DA=k1×N+k2×TによりDAを算定する。
Then, the attention level DA is calculated from the gaze history of the other vehicle data that has been gazed (step 410).
In step 410, during the past predetermined period indicated by the gaze history of the other vehicle data being watched, the number of times the other vehicle was gazed was N, and during the past predetermined period indicated by the gaze history of the other vehicle data being watched. Taking the total time of gazing at the other vehicle as T, the attention level DA is calculated so that the larger the N, the larger the time, and the larger the T, the larger the attention level DA. That is, for example, DA is calculated by DA = k1 × N + k2 × T with DA = N × T and k1 and k2 as predetermined coefficients.

そして、注目度DAが、所定のしきい値ThHより大きいかどうかを調べ(ステップ412)、大きければ、注視していた他車の他車データの関心度を大に設定し(ステップ414)、ステップ402からの処理に戻る。 Then, it is examined whether or not the attention level DA is larger than the predetermined threshold value ThH (step 412), and if it is larger, the degree of interest of the other vehicle data of the other vehicle that was being watched is set to a large value (step 414). Return to the process from step 402.

ただし、ステップ414は、注視していた他車の他車データの関心度として小が登録されている場合には、注視していた他車のモニタの要否をドライバーに問い合わせ、モニタ要を指示された場合に他車データの関心度を大に設定して(ステップ414)、ステップ402からの処理に戻り、モニタ不要を指示された場合には、そのままステップ402からの処理に戻り、注視していた他車の他車データの関心度として中が登録されている場合には、他車データの関心度を大に設定して(ステップ414)、ステップ402からの処理に戻り、注視していた他車の他車データの関心度として大が登録されている場合にはそのままステップ402からの処理に戻るステップとしてもよい。 However, in step 414, when the degree of interest of the other vehicle data of the other vehicle that was being watched is registered as small, the driver is inquired about the necessity of monitoring the other vehicle that was being watched, and the monitoring is instructed. If this is the case, set the degree of interest in the other vehicle data to a large value (step 414), return to the process from step 402, and if instructed that monitoring is unnecessary, return to the process from step 402 and pay close attention. If the inside is registered as the degree of interest of the other vehicle data of the other vehicle, set the degree of interest of the other vehicle data to a large value (step 414), return to the process from step 402, and pay attention. If a large degree of interest in other vehicle data of another vehicle is registered, the step may be a step of returning to the process from step 402 as it is.

ここで、注視していた他車のモニタの要否の問い合わせは、注視していた他車の他車データの色や車種の情報を用いて、たとえば、「赤い、AA(AAは車種名)をモニタしますか」といった音声による問い合わせを音声出力装置6から出力することにより行う。 Here, inquiries about the necessity of monitoring the other vehicle that was being watched are made using, for example, "red, AA (AA is the vehicle model name)" using the color and vehicle model information of the other vehicle data that was being watched. Is made by outputting a voice inquiry such as "Do you want to monitor?" From the voice output device 6.

次に、注目度DAが、所定のしきい値ThHより大きくなければ(ステップ412)、注目度DAが、所定のしきい値ThLより大きいかどうかを調べる(ステップ416)。ただし、ThL<ThHである。 Next, if the attention level DA is not greater than the predetermined threshold value ThH (step 412), it is examined whether the attention level DA is larger than the predetermined threshold value ThL (step 416). However, ThL <ThH.

そして、注目度DAが、しきい値ThLより大きければ(ステップ416)、注視していた他車データの関心度を中に設定し(ステップ418)、ステップ402からの処理に戻る。 Then, if the attention level DA is larger than the threshold value ThL (step 416), the degree of interest of the other vehicle data to be watched is set to the middle (step 418), and the process returns to the process from step 402.

ただし、ステップ418は、注視していた他車の他車データの関心度として小が登録されている場合には、注視していた他車のモニタの要否をドライバーに問い合わせ、モニタ要を指示された場合に他車データの関心度を中に設定して(ステップ418)、ステップ402からの処理に戻り、モニタ不要を指示された場合には、そのままステップ402からの処理に戻り、(ステップ414)、注視していた他車の他車データの関心度として中が登録されている場合には、そのままステップ402からの処理に戻り、注視していた他車の他車データの関心度として大が登録されている場合には、他車データの関心度を中に設定してステップ402からの処理に戻るステップとしてもよい。 However, in step 418, when the degree of interest of the other vehicle data of the other vehicle that was being watched is registered as small, the driver is inquired about the necessity of monitoring the other vehicle that was being watched, and the monitoring is instructed. If this is the case, the degree of interest in the other vehicle data is set to medium (step 418), the process returns from step 402, and if the monitor is instructed, the process returns to step 402 as it is (step). 414) If the inside is registered as the degree of interest of the other vehicle data of the other vehicle that was being watched, the process returns to the process from step 402 as it is, and as the degree of interest of the other vehicle data of the other vehicle that was being watched. If a large number is registered, the degree of interest in other vehicle data may be set to medium and the process may be returned to the process from step 402.

また、注目度DAが、しきい値ThLより大きくなければ(ステップ416)、注視していた他車データの関心度を小に設定し(ステップ420)、ステップ402からの処理に戻る。 If the attention level DA is not larger than the threshold value ThL (step 416), the degree of interest of the other vehicle data to be watched is set to a small value (step 420), and the process returns to the process from step 402.

以上、制御装置4が行う関心度設定処理について説明した。
このような関心度設定処理によれば、ドライバーが大きな関心をもっている他車であるために高い頻度で目視確認した他車の他車データの関心度が大に設定され、ドライバーが中程度の関心をもっている他車であるために中程度の頻度で目視確認した他車の他車データの関心度が中に設定され、ドライバーが関心がないために低い頻度でした目視確認していない他車の他車データの関心度が小に設定される。
The interest level setting process performed by the control device 4 has been described above.
According to such a degree of interest setting process, the degree of interest of the data of other vehicles visually confirmed with high frequency is set to be high because the other vehicle is of great interest to the driver, and the driver is of moderate interest. The interest level of the other vehicle data of other vehicles that was visually confirmed at a medium frequency was set to medium because it is another vehicle that has, and it was low frequency because the driver was not interested. The degree of interest in other vehicle data is set to small.

なお、以上の関心度設定処理では、ステップ410において、注視していた他車データの注視履歴が示す過去所定期間中に、当該他車を注視した回数Nを、注目度DAとして算出するようにしてもよい。または、ステップ410において、注視していた他車データの注視履歴が示す、過去所定期間中に当該他車を注視した時間の合計Tを注目度DAとして算出するようにしてもよい。 In the above-mentioned interest level setting process, in step 410, the number of times N of gazing at the other vehicle during the past predetermined period indicated by the gazing history of the other vehicle data being watched is calculated as the attention level DA. You may. Alternatively, in step 410, the total T of the time during which the other vehicle was gazed during the past predetermined period indicated by the gaze history of the other vehicle data that was being gazed may be calculated as the attention level DA.

以下、制御装置4が行う他車情報の提示動作について説明する。
制御装置4は、他車情報の提示として、ディスプレイ5への他車の位置表示と、音声出力装置6からの他車情報の音声による出力を行う。
まず、ディスプレイ5への他車の位置表示の動作について説明する。
制御装置4は、ディスプレイ5に、たとえば、図5に示すような、自車と他車の位置関係を示す他車提示画像を表示すると共に、一定時間周期で他車提示画像を更新する。
他車提示画像には、自車を表す自車マーク501と、前回の他車提示画像の更新後に位置履歴が更新された他車データに対応する他車を表す他車マーク511、512、513、514を表示する。各他車マーク511/512/513/514は、他車データの位置履歴の最新の位置が表す、他車データに対応する他車と自車との位置関係を、当該他車マーク511/512/513/514と自車マーク501との位置関係によって表すように表示する。
Hereinafter, the operation of presenting other vehicle information performed by the control device 4 will be described.
The control device 4 displays the position of the other vehicle on the display 5 and outputs the other vehicle information by voice from the voice output device 6 as the presentation of the other vehicle information.
First, the operation of displaying the position of another vehicle on the display 5 will be described.
The control device 4 displays, for example, another vehicle presentation image showing the positional relationship between the own vehicle and the other vehicle on the display 5, and updates the other vehicle presentation image at regular time intervals.
The other vehicle presentation image includes the own vehicle mark 501 representing the own vehicle and the other vehicle mark 511, 512, 513 indicating the other vehicle corresponding to the other vehicle data whose position history has been updated since the previous update of the other vehicle presentation image. 514 is displayed. Each other vehicle mark 511/512/513/514 indicates the positional relationship between the other vehicle and the own vehicle corresponding to the other vehicle data, which is represented by the latest position in the position history of the other vehicle data. It is displayed so as to be represented by the positional relationship between / 513/514 and the own vehicle mark 501.

また、各他車マーク511/512/513/514は、対応する他車データの関心度に応じた形態で表示する。
すなわち、図6に示すルールに従って、他車提示画像による他車の位置表示では、関心度が小の他車データに対応する他車マーク511、512は通常の形態で表示し、関心度が中の他車データに対応する他車マーク513は通常の形態よりも少し強調した形態で表示し、関心度が大の他車データに対応する他車マーク514は、関心度が中の他車マーク513よりも、さらに強く強調した形態で表示する。
Further, each other vehicle mark 511/512/513/514 is displayed in a form according to the degree of interest of the corresponding other vehicle data.
That is, according to the rule shown in FIG. 6, in the position display of the other vehicle by the image presented by the other vehicle, the other vehicle marks 511 and 512 corresponding to the data of the other vehicle having a small degree of interest are displayed in the normal form, and the degree of interest is medium. The other vehicle mark 513 corresponding to the other vehicle data is displayed in a form slightly emphasized than the normal form, and the other vehicle mark 514 corresponding to the other vehicle data with a high degree of interest is the other vehicle mark with a medium degree of interest. It is displayed in a form that is more strongly emphasized than 513.

次に、制御装置4が行う、音声出力装置6からの他車情報の音声による出力の動作について説明する。
制御装置4は、他車管理テーブル9の、関心度として中、大が登録されている他車データに対応する他車の挙動を、当該他車データの位置履歴に基づいて継続的に監視する処理を行う。
Next, the operation of voice output of other vehicle information from the voice output device 6 performed by the control device 4 will be described.
The control device 4 continuously monitors the behavior of the other vehicle corresponding to the other vehicle data in which the degree of interest is registered as medium or large in the other vehicle management table 9 based on the position history of the other vehicle data. Perform processing.

そして、関心度として中または大が登録されている他車データに対応する他車の挙動が変化し、当該他車が車線変更や自車への接近などの自車に関連する挙動を行ったならば、「赤い、AA(AAは車種名)が右車線に移動しました」、「黒いBB(BBは車種名)が左車線から接近してきます」、「シルバーのCC(CCは車種名)が前に入ろうとしています」といったような、その他車の特徴と当該他車が行った挙動を示す音声メッセージを音声出力装置6から出力する。 Then, the behavior of the other vehicle corresponding to the data of the other vehicle for which medium or large is registered as the degree of interest changed, and the other vehicle performed behavior related to the own vehicle such as changing lanes or approaching the own vehicle. Then, "Red, AA (AA is the model name) has moved to the right lane", "Black BB (BB is the model name) is approaching from the left lane", "Silver CC (CC is the model name) The voice output device 6 outputs a voice message indicating the characteristics of the other vehicle and the behavior of the other vehicle, such as "is about to enter the front."

なお、当該音声メッセージで用いる他車の色や車種は他車データから取得することができる。
また、関心度として大が登録されている他車データに対応する他車については、当該他車の挙動が変化し、分岐点での自車走行道路外の他の道路への進行などの、当該他車が直接自車に関連しない挙動を行った場合にも、「赤い、AA(AAは車種名)が分岐していきました」といったような、その他車の特徴と当該他車が行った挙動を示す音声メッセージを音声出力装置6から出力する。
The color and model of the other vehicle used in the voice message can be obtained from the data of the other vehicle.
In addition, for other vehicles that correspond to the data of other vehicles for which a large degree of interest is registered, the behavior of the other vehicle will change, and the vehicle will proceed to another road outside the vehicle's own road at the fork. Even if the other vehicle behaves not directly related to the own vehicle, the other vehicle's characteristics such as "red, AA (AA is the model name) has branched off" and the other vehicle performed. A voice message indicating the behavior is output from the voice output device 6.

ここで、制御装置4は、他車の位置が検出できなくなったことも自車に関連しない挙動の一つとし、関心度として大が登録されている他車データの位置履歴が一定期間更新されなくなったならば、「赤い、AA(AAは車種名)がモニタできなくなりました」といった音声メッセージを音声出力装置6から出力する。また、制御装置4は、一旦、位置が検出できなくなった他車の位置が再度検出できるようになったことも自車に関連しない挙動の一つとし、関心度として大が登録されている他車データの位置履歴が一定期間更新されなくなった後に再度更新されるようになったならば、「赤い、AA(AAは車種名)は後方を走行中です」といった音声メッセージを音声出力装置6から出力する。 Here, the control device 4 considers that the position of the other vehicle cannot be detected as one of the behaviors not related to the own vehicle, and the position history of the other vehicle data in which the degree of interest is registered is updated for a certain period of time. If it disappears, a voice message such as "Red, AA (AA is the vehicle model name) can no longer be monitored" is output from the voice output device 6. In addition, the control device 4 can detect the position of another vehicle whose position cannot be detected again, which is one of the behaviors not related to the own vehicle, and the degree of interest is registered as high. If the position history of the vehicle data is not updated for a certain period of time and then is updated again, a voice message such as "Red, AA (AA is the vehicle model name) is driving behind" is sent from the voice output device 6. Output.

また、制御装置4は、図6に示すルールに従って、関心度として大が登録されている他車データに対応する他車については、挙動の変化がなくても、定期的に、「黒いBB(BBは車種名)は、まだ後ろを走行しています」といったような、他車の現在の挙動を示す音声メッセージを音声出力装置6から出力する。 Further, according to the rule shown in FIG. 6, the control device 4 periodically "black BB (black BB)" for the other vehicle corresponding to the data of the other vehicle whose degree of interest is registered to be large, even if there is no change in the behavior. The voice output device 6 outputs a voice message indicating the current behavior of another vehicle, such as "BB is the vehicle model name), which is still running behind."

以上の制御装置4の動作によれば、関心度が小に設定された他車データの他車については音声出力による他車情報の提示は行われず、関心度が中に設定された他車データの他車については自車に関連する挙動の発生の通知が音声出力による他車情報の提示として行われる。そして、関心度が大に設定された他車データの他車については、挙動変化によって発生した全ての挙動の通知が音声出力による他車情報の提示として行われる他、定期的に当該他車の現在の挙動の通知が音声出力による他車情報の提示として行われる。 According to the operation of the control device 4 described above, the other vehicle information is not presented by voice output for the other vehicle data of the other vehicle whose interest level is set to be low, and the other vehicle data whose interest level is set to medium. For other vehicles, notification of the occurrence of behavior related to the own vehicle is performed as presentation of other vehicle information by voice output. Then, for other vehicles in the data of other vehicles for which the degree of interest is set to a high level, notification of all behaviors generated by the behavior change is performed as presentation of other vehicle information by voice output, and the other vehicles are periodically notified. Notification of the current behavior is performed as presentation of other vehicle information by voice output.

以上、本発明の実施形態について説明した。
このように本実施形態に係る周辺監視システムは、ドライバーが注視している程度が大きい他車を自動的に抽出して、その情報を提示する。ここで、ドライバーが注視している程度が大きい他車は、ドライバーが関心を示している他車であるので、本周辺監視システムによれば、ドライバーの煩雑な操作を必要とすることなく、ドライバーが真に関心をもっている他車の情報をドライバーに提示することができる。また、注視している程度が大きい他車、すなわち、ドライバーが関心を示している程度が大きい他車ほど、よりきめ細かく、その情報を提示するので、ドライバーの関心の強さに適した内容の情報を、ドライバーに提示することができる。
The embodiment of the present invention has been described above.
As described above, the peripheral monitoring system according to the present embodiment automatically extracts other vehicles that the driver is paying close attention to and presents the information. Here, the other vehicle that the driver is paying close attention to is the other vehicle that the driver is interested in. Therefore, according to this peripheral monitoring system, the driver does not need to perform complicated operations. Can present information to the driver about other vehicles that he is really interested in. In addition, other vehicles that are more closely watched, that is, other vehicles that the driver is more interested in, present the information in more detail, so the information is suitable for the strength of the driver's interest. Can be presented to the driver.

ところで、以上の実施形態では、ドライバーが他車を注視した程度にのみ応じて他車の関心度を設定したが、これは、DMS8で助手席の搭乗者の視点と注視方向も検出し、ドライバーが他車を注視した程度に加え、助手席の搭乗者が他車を注視した程度も考慮して他車の他車データの関心度を設定するようにしてもよい。 By the way, in the above embodiment, the degree of interest of the other vehicle is set only according to the degree to which the driver gazes at the other vehicle. However, the DMS8 also detects the viewpoint and the gaze direction of the passenger in the passenger seat, and the driver. In addition to the degree to which the passenger looks at the other vehicle, the degree of interest in the data of the other vehicle may be set in consideration of the degree to which the passenger in the passenger seat gazes at the other vehicle.

また、ドライバーが他車を注視していた期間中における、他車の挙動や他車と自車の関係を考慮して関心度を設定するようにしてもよい。すなわち、たとえば、後方にいる他車の車線変更前の所定時間長さ(たとえば、5秒)前の時点から車線変更後の所定時間(たとえば、5秒)長さ後の時点まで継続して、当該他車を注視し続けている場合には、当該他車の他車データの関心度を大や中に設定するようにするなどしてよい。 Further, the degree of interest may be set in consideration of the behavior of the other vehicle and the relationship between the other vehicle and the own vehicle during the period when the driver is watching the other vehicle. That is, for example, the time point before the predetermined time length (for example, 5 seconds) before the lane change of the other vehicle behind is continued from the time point after the predetermined time (for example, 5 seconds) length after the lane change. If the other vehicle continues to be closely watched, the degree of interest in the other vehicle data of the other vehicle may be set to large or medium.

また、DMS8でドライバーや助手席の搭乗者の動作を検出し、他車を指さす動作や、他車の方向に首を振ったり、他車の方向に振り返る動作など、他車を指示する動作が発生した場合に、当該他車の他車データの関心度を大きくするようにしてもよい。 In addition, the DMS8 detects the movements of the driver and passengers in the passenger seat, points to another vehicle, shakes the head in the direction of the other vehicle, and looks back in the direction of the other vehicle. When it occurs, the degree of interest in other vehicle data of the other vehicle may be increased.

また、音声入力装置7で音声認識した音声が「後ろの車」などの他車を指示する音声であった場合に、当該音声で指示された他車の他車データの関心度を大きくするようにしてもよい。
また、以上の実施形態は、他車データの属性に、他車データに対応する他車が、自車と同行している自動車であるかどうかを登録し、他車データの属性に応じて、他車情報の提示の形態を行うようにしてもよい。
Further, when the voice recognized by the voice input device 7 is a voice instructing another vehicle such as "the car behind", the degree of interest in the data of the other vehicle of the other vehicle instructed by the voice is increased. It may be.
Further, in the above embodiment, whether or not the other vehicle corresponding to the other vehicle data is a vehicle accompanying the own vehicle is registered in the attribute of the other vehicle data, and according to the attribute of the other vehicle data, Other vehicle information may be presented in the form of presentation.

すなわち、たとえば、登録されている関心度が大や中で他車データの属性が同行している自動車であることを表している他車データの他車については、上述した関心度が大や中である他車データの他車についての音声メッセージの出力に加えて、当該他車が自車から所定距離以上離れたならば、その旨を通知する音声メッセージを出力するようにしてよい。 That is, for example, the above-mentioned interest level is high or medium for other vehicles in the other vehicle data indicating that the registered vehicle has a high or medium degree of interest and the attribute of the other vehicle data is accompanied. In addition to the output of the voice message about the other vehicle in the data of the other vehicle, if the other vehicle is separated from the own vehicle by a predetermined distance or more, a voice message notifying the fact may be output.

また、この場合において、他車が自車と同行している自動車であるかどうか属性の設定は、図5に示した他車提示画像上でのドライバーの他車の選択と、選択した他車に対する属性設定操作に応じて行うようにしてもよいし、DMS8でドライバーが他車を注視していたときのドライバーの表情を検出し、検出した表情がにこやかであった場合などに自動的に行うようにしてもよい。
以上の実施形態は、他車提示画像の表示は行わないようにしてもよい。
Further, in this case, the setting of the attribute of whether or not the other vehicle is a vehicle accompanying the own vehicle is determined by selecting the driver's other vehicle on the other vehicle presentation image shown in FIG. 5 and selecting the other vehicle. It may be performed according to the attribute setting operation for the vehicle, or the DMS8 detects the driver's facial expression when the driver is gazing at another vehicle and automatically performs the detected facial expression when the driver is smiling. You may do so.
In the above embodiment, the image presented by another vehicle may not be displayed.

1…カメラ、2…レーダ、3…他車認識装置、4…制御装置、5…ディスプレイ、6…音声出力装置、7…音声入力装置、8…DMS、9…他車管理テーブル。 1 ... Camera, 2 ... Radar, 3 ... Other vehicle recognition device, 4 ... Control device, 5 ... Display, 6 ... Voice output device, 7 ... Voice input device, 8 ... DMS, 9 ... Other vehicle management table.

Claims (10)

自動車周辺の他車の情報を提示する周辺監視システムであって、
前記自動車周辺の他車を認識する他車認識手段と、
前記自動車のドライバーの前記自動車周辺の他車の注視状況を検出する注視状況検出手段と、
前記他車認識手段が認識した他車の情報を前記ドライバーに提示する他車情報提示手段とを有し、
前記他車情報提示手段は、前記他車認識手段が認識した他車のうち、前記注視状況検出手段が検出している注視状況が表すドライバーが注視している程度である注視程度が所定のレベルより大きい他車を監視対象他車に設定し、継続的に前記監視対象他車の情報を提示することを特徴とする周辺監視システム。
It is a peripheral monitoring system that presents information on other vehicles around the vehicle.
Other vehicle recognition means that recognizes other vehicles around the vehicle,
Gaze status detecting means for detecting the gaze status of another vehicle around the vehicle by the driver of the vehicle, and
It has another vehicle information presenting means for presenting the other vehicle information recognized by the other vehicle recognition means to the driver.
Among the other vehicles recognized by the other vehicle recognition means, the other vehicle information presenting means has a predetermined level of gaze, which is the degree to which the driver is gazing at the gaze status detected by the gaze status detecting means. A peripheral monitoring system characterized in that a larger other vehicle is set as a monitored other vehicle and information on the monitored other vehicle is continuously presented.
請求項1記載の周辺監視システムであって、
前記他車情報提示手段は、監視対象他車の情報の提示を当該情報を表す音声出力により行うと共に、前記他車認識手段が認識した他車のうちの監視対象他車でない他車の情報の音声出力による提示は行わないことを特徴とする周辺監視システム。
The peripheral monitoring system according to claim 1.
The other vehicle information presenting means presents information on the other vehicle to be monitored by voice output representing the information, and information on other vehicles other than the other vehicle to be monitored among the other vehicles recognized by the other vehicle recognition means. Peripheral monitoring system characterized by not presenting by voice output.
請求項1または2記載の周辺監視システムであって、
前記他車認識手段は、前記自動車周辺の他車の挙動を検出し、
前記他車情報提示手段は、前記他車認識手段が検出している前記監視対象他車の所定の挙動が発生したときに、当該挙動の発生を当該監視対象他車の情報として提示することを特徴とする周辺監視システム。
The peripheral monitoring system according to claim 1 or 2.
The other vehicle recognition means detects the behavior of another vehicle around the vehicle and detects the behavior of the other vehicle.
When the predetermined behavior of the monitored other vehicle detected by the other vehicle recognition means occurs, the other vehicle information presenting means presents the occurrence of the behavior as information on the monitored other vehicle. A featured peripheral monitoring system.
自動車周辺の他車の情報を提示する周辺監視システムであって、
前記自動車周辺の他車を認識する他車認識手段と、
前記自動車のドライバーの前記自動車周辺の他車の注視状況を検出する注視状況検出手段と、
前記他車認識手段が認識した他車の情報を前記ドライバーに提示する他車情報提示手段とを有し、
前記他車情報提示手段は、前記他車認識手段が認識した他車のうち、前記注視状況検出手段が検出している注視状況が表すドライバーが注視している程度である注視程度が所定のレベルである第1レベルより大きい他車の情報を、前記注視程度が前記第1レベルより大きくない他車の情報よりも、よりきめ細かく提示することを特徴とする周辺監視システム。
It is a peripheral monitoring system that presents information on other vehicles around the vehicle.
Other vehicle recognition means that recognizes other vehicles around the vehicle,
Gaze status detecting means for detecting the gaze status of another vehicle around the vehicle by the driver of the vehicle, and
It has another vehicle information presenting means for presenting the other vehicle information recognized by the other vehicle recognition means to the driver.
Among the other vehicles recognized by the other vehicle recognition means, the other vehicle information presenting means has a predetermined level of gaze, which is the degree to which the driver is gazing at the gaze status detected by the gaze status detecting means. A peripheral monitoring system characterized in that information on another vehicle larger than the first level is presented in more detail than information on another vehicle whose gaze level is not greater than the first level.
請求項4記載の周辺監視システムであって、
前記他車情報提示手段は、前記他車認識手段が認識した他車のうち、前記注視程度が前記第1レベルより小さいレベルである第2レベルより大きい他車の情報を提示すると共に、前記注視程度が前記第1レベルより大きい他車の情報を、前記注視程度が前記第2レベルより大きく前記第1レベルより大きくない他車の情報よりも、よりきめ細かく提示することを特徴とする周辺監視システム。
The peripheral monitoring system according to claim 4.
The other vehicle information presenting means presents information on another vehicle recognized by the other vehicle recognition means, which is larger than the second level, which is a level smaller than the first level, and the gaze is present. A peripheral monitoring system characterized in that information on another vehicle whose degree is greater than the first level is presented in more detail than information on another vehicle whose gaze degree is greater than the second level and not greater than the first level. ..
請求項5記載の周辺監視システムであって、
前記他車情報提示手段は、他車の情報の提示を当該情報を表す音声出力により行うものであると共に、前記注視程度が前記第2レベルより大きくない他車の情報の音声出力による提示は行わないことを特徴とする周辺監視システム。
The peripheral monitoring system according to claim 5.
The other vehicle information presenting means presents the information of the other vehicle by voice output representing the information, and also presents the information of the other vehicle whose gaze level is not greater than the second level by voice output. Peripheral monitoring system characterized by no.
請求項6記載の周辺監視システムであって、
前記他車認識手段は、前記自動車周辺の他車の挙動を検出し、
前記他車情報提示手段は、前記他車認識手段が認識した他車のうち、前記注視程度が前記第2レベルより大きく前記第1レベルより大きくない他車の予め第1グループに分類した挙動が発生したときに、当該挙動の発生を当該他車の情報として音声出力により提示し、前記注視程度が前記第1レベルより大きい他車の前記第1グループに分類した挙動と予め第2グループに分類した挙動のいずれかが発生したときに、当該挙動の発生を当該他車の情報として音声出力により提示し、
前記第1グループに分類された挙動と、前記第2グループに分類された挙動とは異なることを特徴とする周辺監視システム。
The peripheral monitoring system according to claim 6.
The other vehicle recognition means detects the behavior of another vehicle around the vehicle and detects the behavior of the other vehicle.
Among the other vehicles recognized by the other vehicle recognition means, the other vehicle information presenting means has behaviors in which the other vehicles whose gaze level is larger than the second level and not larger than the first level are classified into the first group in advance. When it occurs, the occurrence of the behavior is presented as information of the other vehicle by voice output, and the behavior classified into the first group of the other vehicle whose gaze level is greater than the first level and the behavior classified into the second group in advance. When any of the behaviors that have been performed occurs, the occurrence of the behavior is presented as information on the other vehicle by voice output.
A peripheral monitoring system characterized in that the behavior classified into the first group is different from the behavior classified into the second group.
請求項1、2、3、4、5、6または7記載の周辺監視システムであって、
前記他車情報提示手段は、前記注視程度を、注視した回数が大きくなるほど大きくなり、注視した期間の時間長が大きくなるほど大きくなるように算定することを特徴とする周辺監視システム。
The peripheral monitoring system according to claim 1, 2, 3, 4, 5, 6 or 7.
The other vehicle information presenting means is a peripheral monitoring system characterized in that the degree of gaze is calculated so as to increase as the number of times of gaze increases and as the length of time of the gaze period increases.
自動車周辺の他車の情報を提示する周辺監視システムであって、
前記自動車周辺の他車を認識する他車認識手段と、
前記自動車のドライバーの前記自動車周辺の他車に関心を払う行動の発生を検出する行動検出手段と、
前記他車認識手段が認識した他車の情報を前記ドライバーに提示する他車情報提示手段とを有し、
前記他車情報提示手段は、前記他車認識手段が認識した他車のうち、前記行動検出手段が当該他車に対する関心を払う行動の発生を検出した他車を監視対象他車に設定し、継続的に前記監視対象他車の情報を提示することを特徴とする周辺監視システム。
It is a peripheral monitoring system that presents information on other vehicles around the vehicle.
Other vehicle recognition means that recognizes other vehicles around the vehicle,
Behavior detection means for detecting the occurrence of behavior of the driver of the vehicle to pay attention to other vehicles around the vehicle.
It has another vehicle information presenting means for presenting the other vehicle information recognized by the other vehicle recognition means to the driver.
Among the other vehicles recognized by the other vehicle recognition means, the other vehicle information presenting means sets the other vehicle in which the action detecting means detects the occurrence of an action that pays attention to the other vehicle as the monitored other vehicle. A peripheral monitoring system characterized by continuously presenting information on the other vehicle to be monitored.
請求項9記載の周辺監視システムであって、
前記行動検出手段が検出する他車に関心を払う行動は、少なくとも他車を指さす行動を含むことを特徴とする周辺監視システム。
The peripheral monitoring system according to claim 9.
A peripheral monitoring system characterized in that an action of paying attention to another vehicle detected by the action detecting means includes at least an action of pointing to another vehicle.
JP2019218018A 2019-12-02 2019-12-02 Perimeter Monitoring System Active JP7466985B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2019218018A JP7466985B2 (en) 2019-12-02 2019-12-02 Perimeter Monitoring System

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2019218018A JP7466985B2 (en) 2019-12-02 2019-12-02 Perimeter Monitoring System

Publications (2)

Publication Number Publication Date
JP2021089470A true JP2021089470A (en) 2021-06-10
JP7466985B2 JP7466985B2 (en) 2024-04-15

Family

ID=76220666

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019218018A Active JP7466985B2 (en) 2019-12-02 2019-12-02 Perimeter Monitoring System

Country Status (1)

Country Link
JP (1) JP7466985B2 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06251287A (en) * 1993-02-23 1994-09-09 Mitsubishi Electric Corp Driving assistance system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001175992A (en) 1999-12-14 2001-06-29 Mazda Motor Corp Display device for vehicle
JP2008013070A (en) 2006-07-06 2008-01-24 Toyota Motor Corp Vehicular display device
JP4231884B2 (en) 2006-09-27 2009-03-04 株式会社デンソーアイティーラボラトリ Gaze object detection device and gaze object detection method
JP2012022589A (en) 2010-07-16 2012-02-02 Hitachi Ltd Method of supporting selection of commodity
JP2013225226A (en) 2012-04-23 2013-10-31 Kyocera Corp Information terminal, display control program and display control method
JP2018148530A (en) 2017-03-09 2018-09-20 株式会社Jvcケンウッド Vehicle display controller, vehicle display system, vehicle display control method, and program

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06251287A (en) * 1993-02-23 1994-09-09 Mitsubishi Electric Corp Driving assistance system

Also Published As

Publication number Publication date
JP7466985B2 (en) 2024-04-15

Similar Documents

Publication Publication Date Title
US10421459B2 (en) Contextual-assessment vehicle systems
US20220189307A1 (en) Presentation of dynamic threat information based on threat and trajectory prediction
US10009580B2 (en) Method for supplementing a piece of object information assigned to an object and method for selecting objects in surroundings of a vehicle
EP2544161B1 (en) Surrounding area monitoring device for vehicle
JP6964064B2 (en) Methods to assist in the operation of your vehicle, methods to assist other traffic participants, and corresponding support systems and vehicles
WO2016067544A1 (en) Vehicle-mounted attention-attracting system and notification control device
US9758098B2 (en) Vehicle periphery monitoring device
JP3160108B2 (en) Driving support system
KR20240067906A (en) Vehicle and mobile device interface for vehicle occupant assistance
KR20240074777A (en) Vehicle and mobile device interface for vehicle occupant assistance
JP5286035B2 (en) Vehicle speed control device
JP2004535971A (en) Head-up display system and method
US20170280063A1 (en) Stereo image generating method using mono cameras in vehicle and providing method for omnidirectional image including distance information in vehicle
JP6891926B2 (en) Vehicle systems, methods performed on vehicle systems, and driver assistance systems
US20230004154A1 (en) Method for remotely controlled driving of a motor vehicle comprising a teleoperator, computer program product, and teleoperation driving system
WO2018220774A1 (en) Driving assistance device, driving assistance system, and driving assistance method
CN114842433A (en) Rendering of objects in a saliency-based image
JPH11139229A (en) Running environment supervisory alarm device
US20230356746A1 (en) Presentation control device and non-transitory computer readable medium
JP2021089470A (en) Periphery monitoring system
US11807264B2 (en) Driving assistance apparatus, driving assistance method, and medium
JP2020095466A (en) Electronic device
JP2006015803A (en) Display device for vehicle and vehicle on which display device for vehicle is mounted
JP2019086983A (en) Driving support device, driving condition information acquisition system, driving support method, and program
JP6476644B2 (en) Cognitive assist device

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220921

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230727

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230808

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230929

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240109

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240402

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240402

R150 Certificate of patent or registration of utility model

Ref document number: 7466985

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150