JPH11276461A - Attention measuring device and information presenting device using the same - Google Patents
Attention measuring device and information presenting device using the sameInfo
- Publication number
- JPH11276461A JPH11276461A JP10100445A JP10044598A JPH11276461A JP H11276461 A JPH11276461 A JP H11276461A JP 10100445 A JP10100445 A JP 10100445A JP 10044598 A JP10044598 A JP 10044598A JP H11276461 A JPH11276461 A JP H11276461A
- Authority
- JP
- Japan
- Prior art keywords
- attention
- operator
- information
- jumping
- level
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
Abstract
Description
【０００１】[0001]
【発明の属する技術分野】本発明は、操作者の眼球運動
を利用して注意力を測定する注意力測定装置、及びこれ
を用いた情報提示装置に関する。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an attention measuring device for measuring attention using an eye movement of an operator, and an information presentation device using the same.
【０００２】[0002]
【従来の技術】以下、「操作者」とは、運転者、作業者
等を一括していうものとし、単に「機械」とは、自動
車、工作機械等を一括していうものとする。2. Description of the Related Art Hereinafter, an "operator" refers to a driver, an operator and the like collectively, and a "machine" simply refers to an automobile, a machine tool and the like.
【０００３】カーナビゲーションのアナウンス、携帯電
話の呼出し音、自動車運転における車間距離警告や、工
作機械の警報等は、各装置において測定した何らかの数
値が一定の閾値を越えた場合や、何らかのイベントが発
生した場合に、突発的に操作者に対して提示される情報
である。これらの情報について、以下に例示する。，
は、緊急度の低い通知情報であり、，は緊急度の
高い警告情報である。[0003] Announcements of car navigation, ringing sounds of mobile phones, inter-vehicle distance warnings during driving, warnings of machine tools, etc. occur when a certain numerical value measured in each device exceeds a certain threshold value or an event occurs. In this case, the information is suddenly presented to the operator. Examples of such information are described below. ,
Is notification information of low urgency, and is warning information of high urgency.
【０００４】．カーナビゲーションでは、予め設定し
た目標地点から一定距離に自動車が近付いた時、そのこ
とを音声で知らせる。 ．自動車運転中に、携帯電話の着信があった時に、呼
出し用のベルが鳴る。 ．車間距離警告装置では、車速等から決定される一定
閾値を前走車との間隔が下回った時、警告が発せられ
る。 ．工作機械では、温度が一定閾値を越えた時に、警告
が発せられる。[0004] In car navigation, when a vehicle approaches a predetermined distance from a preset target point, the fact is notified by voice. . A ringing bell rings when a mobile phone arrives while driving a car. . In the inter-vehicle distance warning device, a warning is issued when an interval between the vehicle and a preceding vehicle falls below a certain threshold value determined from a vehicle speed or the like. . In machine tools, a warning is issued when the temperature exceeds a certain threshold.
【０００５】[0005]
【発明が解決しようとする課題】通常、操作者は、視
覚、聴覚、触覚等から複数の情報を並列して取り込み、
これらの情報を総合判断して機械を操作している。機械
から操作者へ提示される情報も、単独の場合は少なく、
複数の情報がその場に合わせて提示される。これらの多
くの情報は緊急度が一定ではなく、更に情報提示する以
前に操作者がその情報に気付いている可能性もある。そ
の結果、従来技術では次のような問題が生じていた。Normally, an operator takes in plural pieces of information in parallel from sight, hearing, touch, etc.
The machine is operated by comprehensively judging this information. The information presented from the machine to the operator is also rare in a single case,
Multiple pieces of information are presented on the spot. The urgency of many of these information is not constant, and the operator may be aware of the information before presenting the information. As a result, the prior art has the following problems.
【０００６】・交通量の多い市街地等で、運転者の情報
処理量及び操作量が多いときに、緊急度の低いアナウン
ス情報などを提示すると、却って運転の妨げになる。 ・直線路での定速運転などで運転者の注意力が低下して
いるときでも、一定の車間距離にならなければ警告が発
せられない。 ・運転者は、周囲の状況に充分に注意を払って運転して
いるときに、既に気付いているイベントに対する警報を
機械から受けると、不快感を感じる。 ・運転操作が頻繁に行われ、運転者の情報処理量が多い
ときには、電話の着信があっても、それに応答すること
ができない。[0006] When a driver has a large amount of information processing and a large amount of operation in an urban area or the like with a large traffic volume, presenting announcement information with a low degree of urgency rather hinders driving. -Even when the driver's attention is reduced due to constant speed driving on a straight road, etc., no warning is issued unless the distance between the vehicles is constant. The driver feels discomfort when receiving a warning from the machine for an event that he or she is already aware of while driving with careful attention to the surrounding conditions. When the driving operation is performed frequently and the information processing amount of the driver is large, even if there is an incoming call, it cannot respond to the incoming call.
【０００７】[0007]
【発明の目的】そこで、本発明の目的は、操作者の注意
力の状態に応じて、情報の提示のタイミングが自動的に
変化する、注意力測定装置及びこれを用いた情報提示装
置を提供することにある。SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an attention measuring apparatus and an information presenting apparatus using the same, in which the timing of presenting information automatically changes according to the state of attention of the operator. Is to do.
【０００８】[0008]
【課題を解決するための手段】本発明者は、操作者の注
意力を測定する技術について研究を重ねた結果、飛越眼
球運動の発生頻度と注意力との間に深い関係があること
を見い出した。本発明は、この知見に基づいてなされた
ものである。As a result of repeated research on a technique for measuring the attention of an operator, the present inventor has found that there is a deep relationship between the frequency of occurrence of jumping eye movements and the attention. Was. The present invention has been made based on this finding.
【０００９】飛越眼球運動の発生は、操作者が受ける視
覚刺激と関係がある。例えば、混雑した市街地での運転
など、運転者が通常以上に外界に注意を払っている場合
や、外界からの視覚刺激が多い場合には、飛越眼球運動
の発生頻度が上昇する。しかし、運転者が携帯電話を使
用している場合や同乗者と会話している場合等の、外界
の視覚情報に対する注意力が削がれた状態、又は居眠り
発生時等の注意力が低下した状態では、飛越眼球運動の
発生頻度が低下する。The occurrence of jumping eye movements is related to the visual stimulus experienced by the operator. For example, when the driver pays more attention to the outside world than usual, such as when driving in a crowded city area, or when there is a lot of visual stimulus from the outside world, the frequency of occurrence of jumping eye movement increases. However, when the driver is using a mobile phone or talking with a fellow passenger, the driver's attention to external visual information has been reduced, or the driver's attention has declined when falling asleep. In the state, the occurrence frequency of the skipping eye movement decreases.
【００１０】すなわち、本発明に係る注意力測定装置
は、このような現象を利用したものであり、操作者の飛
越眼球運動を検出する飛越眼球運動検出手段と、この飛
越眼球運動検出手段で検出された飛越眼球運動の発生頻
度に基づき、前記操作者の注意力レベルを判定する注意
力判定手段と、を備えたものである。例えば、前記注意
力判定手段は、前記発生頻度が低いほど前記注意力レベ
ルが低いと判定する。「発生頻度が低いほど注意力レベ
ルが低い」とは、換言すれば、発生頻度が高いほど注意
力レベルが高いということである。That is, the attention measuring apparatus according to the present invention utilizes such a phenomenon, and includes a jumping eyeball movement detecting means for detecting the jumping eyeball movement of the operator, and the jumping eyeball movement detecting means. Attentiveness judging means for judging the level of attention of the operator based on the frequency of occurrence of the skipped eye movement. For example, the attention determination unit determines that the attention level is lower as the occurrence frequency is lower. "The lower the frequency of occurrence, the lower the level of attention" means that the higher the frequency of occurrence, the higher the level of attention.
【００１１】本発明に係る情報提示装置は、本発明に係
る注意力測定装置を用いたものであり、操作者の飛越眼
球運動を検出する飛越眼球運動検出手段と、この飛越眼
球運動検出手段で検出された飛越眼球運動の発生頻度に
基づき、前記操作者の注意力レベルを判定する注意力判
定手段と、この注意力判定手段で判定された注意力レベ
ルに基づき、各種情報の提示のタイミングを決定する各
種情報提示手段と、を備えたものである。例えば、前記
注意力判定手段は、前記発生頻度が低いほど前記注意力
レベルが低いと判定し、前記各種情報提示手段は、前記
注意力判定手段で判定された注意力レベルが低いほど早
く情報を提示する。An information presenting apparatus according to the present invention uses the attention measuring apparatus according to the present invention. The information presenting apparatus includes a jumping eyeball movement detecting means for detecting an operator's jumping eyeball movement, and the jumping eyeball movement detecting means. Attention judging means for judging the level of attention of the operator based on the frequency of occurrence of the detected skipping eye movement, and timing of presentation of various information based on the attention level judged by the attention judging means. And various information presenting means to be determined. For example, the attentiveness determining means determines that the lower the occurrence frequency is, the lower the attentiveness level is, and the various information presenting means, the lower the attentiveness level determined by the attentiveness determining means, the earlier the information is. Present.
【００１２】ここでいう「注意力レベルが低いほど早く
情報を提示する」とは、単に情報を提示する時間を速く
するだけではなく、早く情報を提示するために閾値を変
更することも含まれ、いうまでもなく、注意力レベルが
高いほど遅く情報を提示することも含まれる。この「遅
く情報を提示する」には、情報を全く提示しない場合も
含まれる。すなわち、本発明は、操作者の眼球運動を電
気的又は光学的な手法で計測し、そのな眼球運動の中か
ら飛越眼球運動の頻度を計測して、情報の提示又は非提
示の閾値を変動させるものとも言える。The phrase "present information as the attention level is lower" means not only that the information presentation time is shortened but also that the threshold value is changed in order to present the information earlier. Needless to say, the higher the attention level, the later the information is presented. This “presenting information late” includes the case where no information is presented. That is, the present invention measures the eye movements of the operator by an electrical or optical method, measures the frequency of the skipping eye movements from among such eye movements, and varies the threshold for information presentation or non-presentation. It can also be said to cause.
【００１３】脊椎動物の眼球は、レンズ側が正，網膜側
が負に帯電している。そのため、人体の眼窩周囲の皮膚
表面に電極を貼り付けて電位を測定すると、眼球の傾き
に比例した上下・左右方向の電位差が観測される。この
電位差は、眼電図（Electro-ocurgram、以下「ＥＯＧ」
と略す。）と呼ばれる。一方、飛越眼球運動は、視線が
停留点から急速に移動して次の停留点に止まる現象であ
り、自動車運転中等の視線の動きに多く見られる。飛越
眼球運動の速度は100 〜500 °/secと非常に大きいた
め、ＥＯＧを高域通過フィルタを通して信号処理するこ
とにより飛越眼球運動信号を検出できる。The vertebrate eyeball is positively charged on the lens side and negatively charged on the retina side. Therefore, when an electrode is attached to the skin surface around the orbit of the human body and the potential is measured, a potential difference in the vertical and horizontal directions proportional to the inclination of the eyeball is observed. This potential difference is determined by an electro-ocurgram (hereinafter referred to as “EOG”).
Abbreviated. ). On the other hand, jumping eyeball movement is a phenomenon in which the line of sight moves rapidly from a stop point and stops at the next stop point, and is often seen in the movement of the line of sight while driving a car. Since the speed of the jumping eye movement is very high, 100 to 500 ° / sec, the jumping eye movement signal can be detected by processing the EOG through a high-pass filter.
【００１４】また、飛越眼球運動は、眼球の動きの画像
処理、サーチコイル、眼磁図等によっても検出できる。
眼球の動きの画像処理は、非接触で検出できることが特
長であり、角膜反射法が一般的である。角膜反射法は、
生体外に置いた光源の角膜反射像の位置と瞳孔中心の位
置との差が、眼球回転角に比例することを利用するもの
である。The jumping eye movement can also be detected by image processing of the movement of the eye, a search coil, an electromagneogram, and the like.
The feature of image processing of eyeball movement is that it can be detected in a non-contact manner, and a corneal reflection method is generally used. Corneal reflection method
It utilizes that the difference between the position of the corneal reflection image of the light source placed outside the living body and the position of the center of the pupil is proportional to the eyeball rotation angle.
【００１５】[0015]
【発明の実施の形態】図１は、本発明に係る情報提示装
置の第一実施形態を示すブロック図である。以下、この
図面に基づき説明する。FIG. 1 is a block diagram showing a first embodiment of an information presenting apparatus according to the present invention. Hereinafter, description will be made based on this drawing.
【００１６】本実施形態の情報提示装置１０は、操作者
Ｍの飛越眼球運動Ｅを検出する飛越眼球運動検出手段１
２と、飛越眼球運動検出手段１２で検出された飛越眼球
運動Ｅの発生頻度Ａに基づき、操作者Ｍの注意力レベル
Ｂを判定する注意力判定手段１４と、注意力判定手段１
４で判定された注意力レベルＢに基づき、各種の情報Ｃ
の提示のタイミングを決定する各種情報提示手段１６と
を備えている。注意力判定手段１４は、発生頻度Ａが低
いほど注意力レベルＢが低いと判定する。各種情報提示
手段１６は、注意力判定手段１４で判定された注意力レ
ベルＢが低いほど早く情報Ｃを提示する。なお、飛越眼
球運動検出手段１２及び注意力判定手段１４が、本発明
に係る注意力測定装置である。The information presenting apparatus 10 according to the present embodiment comprises a jumping eye movement detecting means 1 for detecting a jumping eye movement E of an operator M.
2, an attention judging means 14 for judging the attention level B of the operator M based on the occurrence frequency A of the jumping eye movement E detected by the jumping eye movement detecting means 12, and an attention judging means 1
Various information C based on the attention level B determined in 4
And various information presenting means 16 for deciding the timing of presentation. The attention determination unit 14 determines that the attention level B is lower as the occurrence frequency A is lower. The various information presentation means 16 presents the information C earlier as the attention level B determined by the attention determination means 14 is lower. The jumping eye movement detecting means 12 and the attention judging means 14 are the attention measuring apparatus according to the present invention.
【００１７】飛越眼球運動検出手段１２は、電極１２
１、増幅器１２２、高域通過フィルタ１２３、基準パル
ス発生器１２４、比較器１２５等から構成されている。
電極１２１は、図示しないが、操作者Ｍの眼球の上下及
び左右に複数個貼付される。高域通過フィルタ１２３
は、遮断周波数が0.05〜0.1Hz 程度であり、電極１２１
から得られたＥＯＧから低周波を除去することにより、
飛越眼球運動信号ａ2 を分離・検出する。基準パルス発
生器１２４は、一定周期の基準パルス信号ａ1 を出力す
る発振器である。比較器１２５は、飛越眼球運動信号ａ
2 と基準パルス信号ａ1 との周期（又は周波数）を比較
し、その差を発生頻度Ａとして出力する。基準パルス信
号ａ1 の周期は、通常の注意力に対応する発生頻度Ａの
周期に等しく設定されている。例えば、比較器１２５
は、各信号を入力する度にリセットされる二つのタイマ
と、これらのタイマの出力信号の差を演算する差動増幅
器とによって構成される。また、発生頻度Ａを測定する
サンプリング時間によっては出力値が安定しないので、
要求されるレスポンスに合わせて数十秒から数分のサン
プリングタイムを使用して発生頻度Ａを測定するように
してもよい。The jumping eye movement detecting means 12 includes an electrode 12
1, an amplifier 122, a high-pass filter 123, a reference pulse generator 124, a comparator 125 and the like.
Although not shown, a plurality of electrodes 121 are attached to the top, bottom, left, and right of the eyeball of the operator M. High-pass filter 123
Has a cutoff frequency of about 0.05 to 0.1 Hz,
By removing the low frequencies from the EOG obtained from
The separating and detecting interlaced eye movement signals a 2. Reference pulse generator 124 is an oscillator for outputting a reference pulse signal a 1 of the constant period. The comparator 125 outputs the jumping eye movement signal a
2 is compared with the cycle (or frequency) of the reference pulse signal a 1, and the difference is output as the occurrence frequency A. Period of the reference pulse signal a 1 is set equal to the period of frequency A corresponding to the normal attention. For example, the comparator 125
Is composed of two timers that are reset each time each signal is input, and a differential amplifier that calculates the difference between the output signals of these timers. In addition, since the output value is not stable depending on the sampling time for measuring the occurrence frequency A,
The occurrence frequency A may be measured using a sampling time of several tens of seconds to several minutes in accordance with the required response.
【００１８】注意力判定手段１４は、例えばマイクロコ
ンピュータ及びそのプログラムによって構成され、発生
頻度Ａと注意力レベルＢとの対応関係を予め記憶してい
る。The attentiveness judging means 14 is constituted by, for example, a microcomputer and its program, and stores in advance the correspondence between the occurrence frequency A and the attentiveness level B.
【００１９】各種情報提示手段１６は、例えばマイクロ
コンピュータ及びそのプログラムによって構成され、注
意力レベルＢと情報Ｃの出力タイミングとの関係を記憶
しており、カーナビゲーション、車間距離警報装置、携
帯電話、工作機械等に連動するようになっている。The various information presenting means 16 is constituted by, for example, a microcomputer and its program, and stores the relationship between the attention level B and the output timing of the information C, and includes a car navigation system, an inter-vehicle distance alarm device, a cellular phone, It is linked to machine tools and the like.
【００２０】図２乃至図４は、図１の情報提示装置の動
作を示す波形図である。以下、図１乃至図４に基づき説
明する。FIGS. 2 to 4 are waveform diagrams showing the operation of the information presenting apparatus of FIG. Hereinafter, description will be made with reference to FIGS.
【００２１】飛越眼球運動Ｅの発生頻度Ａは飛越眼球運
動信号ａ2 と基準パルス信号ａ1 との周期（周波数）の
差となって現れ、注意力レベル信号Ｂは発生頻度Ａに反
比例する。すなわち、図２に示すように、飛越眼球運動
信号ａ2 の周期が基準パルス信号ａ1 と同程度であれ
ば、飛越眼球運動Ｅの発生頻度Ａが普通であるので、注
意力レベル信号Ｂは中程度と判定される。図３に示すよ
うに、飛越眼球運動信号ａ2 の周期が基準パルス信号ａ
1 よりも短ければ、飛越眼球運動Ｅの発生頻度Ａが多い
ので、注意力レベル信号Ｂは高いと判定される。図４に
示すように、飛越眼球運動信号ａ2 の周期が基準パルス
信号ａ1 よりも長ければ、飛越眼球運動Ｅの発生頻度Ａ
が少ないので、注意力レベル信号Ｂは低いと判定され
る。The occurrence frequency A of the jumping eye movement E appears as a difference in the period (frequency) between the jumping eye movement signal a 2 and the reference pulse signal a 1, and the attention level signal B is inversely proportional to the occurrence frequency A. That is, as shown in FIG. 2, if comparable period of interlaced eye movement signal a 2 is the reference pulse signal a 1, since the occurrence frequency A interlaced eye movement E is normally attentiveness level signal B Determined to be moderate. As shown in FIG. 3, the cycle of the skipping eye movement signal a 2 is the reference pulse signal a.
If it is shorter than 1, it is determined that the attention level signal B is high because the occurrence frequency A of the jumping eye movement E is high. Figure 4 As shown in, the longer than interlaced eye movement signal period reference pulse signal a 1 of a 2, the frequency of occurrence of interlaced eye movement E A
, The attention level signal B is determined to be low.
【００２２】このようにして判定された注意力レベル信
号Ｂは、各種情報提示手段１６に出力される。各種情報
提示手段１６において、電話の着信音や道案内のアナウ
ンス等の、イベントの発生によって操作者Ｍに提示され
る情報Ｃは、それぞれの緊急度や、その処理に要する操
作者の負荷量が予め設定されている。このときの各種情
報提示手段１６の動作を、以下に例示する。The attention level signal B thus determined is output to various information presenting means 16. In the various information presenting means 16, the information C presented to the operator M by the occurrence of an event, such as a ringtone of a telephone call or an announcement of a route guidance, depends on the degree of urgency and the load of the operator required for the processing. It is set in advance. The operation of the various information presenting means 16 at this time is exemplified below.
【００２３】・イベントの緊急度が高い場合や、負荷量
が低い場合には、注意力レベルが高い場合でも、イベン
ト発生を操作者に通知する。 ・イベントの緊急度が低い場合や、負荷量が高い場合に
は、注意力レベルが一定以上ならば、イベントの発生を
操作者に通知しない。 ・イベント発生を操作者に通知しなかった場合、イベン
トの性格によって、遅らせて通知するか、無視するかを
決定する。例えば、電話の着信は後で通知するが、道案
内は通知しない。 ・操作者の注意力レベルが低下している場合は、通常で
は通知しない緊急度の低い情報も通知する。 ・自動車の車間距離警報など、測定値と閾値との比較に
よって運転者に提示される情報については、閾値そのも
のを注意力レベルに連動して変化させる。例えば、飛越
眼球運動の発生頻度が高く、運転者が注意を払いながら
運転しているような場合を基準として、それよりも飛越
眼球運動の発生頻度が下がった場合には、より遠くで車
間距離警報を運転者に提示する。When the urgency of the event is high or the load is low, the operator is notified of the occurrence of the event even if the alert level is high. If the urgency of the event is low or the load is high, the operator is not notified of the occurrence of the event if the attention level is equal to or higher than a certain level. If the event occurrence is not notified to the operator, it is determined whether the notification is delayed or ignored depending on the nature of the event. For example, an incoming call is notified later, but no directions are notified. -When the operator's attention level is low, information of low urgency that is not normally notified is also notified. -For information presented to the driver by comparing the measured value with the threshold value, such as an inter-vehicle distance warning, the threshold value itself is changed in conjunction with the attention level. For example, if the frequency of jumping eye movements is high, and if the driver is driving while paying attention, if the frequency of jumping eye movements is lower than that, the distance between the vehicles is farther An alarm is presented to the driver.
【００２４】図５は、本発明に係る情報提示装置の第二
実施形態を示すブロック図である。以下、この図面に基
づき説明する。ただし、図１と同一部分は同一符号を付
すことにより重複説明を省略する。FIG. 5 is a block diagram showing a second embodiment of the information presentation device according to the present invention. Hereinafter, description will be made based on this drawing. However, the same parts as those in FIG.
【００２５】本実施形態の情報提示装置２０では、操作
者Ｍの飛越眼球運動Ｅを検出する飛越眼球運動検出手段
２２が、第一実施形態と異なっている。飛越眼球運動検
出手段２２は、操作者Ｍの眼球の動きを撮像するＣＣＤ
カメラ等の撮像部２２１と、撮像部２２１で撮像された
眼球の動きから飛越眼球運動Ｅを検出する画像処理部２
２２とから構成されている。画像処理部２２２は、マイ
クロコンピュータ及びその画像処理プログラムから構成
されている。情報提示装置２０は、非接触で飛越眼球運
動Ｅを検出できるという利点がある。In the information presenting apparatus 20 of the present embodiment, the jumping eye movement detecting means 22 for detecting the jumping eye movement E of the operator M is different from the first embodiment. The jumping eye movement detecting means 22 is a CCD that captures the movement of the eye of the operator M.
An imaging unit 221 such as a camera, and an image processing unit 2 that detects a skipping eyeball movement E from the movement of the eyeball imaged by the imaging unit 221
22. The image processing unit 222 includes a microcomputer and an image processing program for the microcomputer. The information presentation device 20 has an advantage that the jumping eye movement E can be detected without contact.
【００２６】なお、本発明は、いうまでもないが、上記
実施形態に限定されるものではない。例えば、飛越眼球
運動検出手段は、サーチコイルや眼磁図等を用いて構成
してもよい。It is needless to say that the present invention is not limited to the above embodiment. For example, the jumping eye movement detecting means may be configured by using a search coil, an eye map, or the like.
【００２７】[0027]
【発明の効果】本発明に係る注意力測定装置によれば、
飛越眼球運動の発生頻度に基づき注意力レベルを判定す
るようにしたので、操作者の注意力の状態を簡単な構成
で正確に測定できる。According to the attention measuring device according to the present invention,
Since the attention level is determined based on the frequency of occurrence of jumping eye movements, the state of attention of the operator can be accurately measured with a simple configuration.
【００２８】本発明に係る情報提示装置によれば、操作
者の注意力の状態に応じて、情報の提示のタイミングが
自動的に変化することにより、以下のように利便性及び
安全性を向上できる。 （１）飛越眼球運動の発生頻度によって操作者の注意力
を測定することにより、操作に充分注意を払っていると
きに冗長な警報を発生することを防止できるので、操作
者の不快感を誘発することを抑止できる。 （２）飛越眼球運動が通常よりも増加したときは、操作
者の注意力が通常の状態よりも高く、操作者の情報処理
負荷が高い状態にあると推測できるため、案内や電話な
どの緊急度の低い情報の提示を抑止することにより、操
作者の情報処理の過負荷を防止できる。 （３）飛越眼球運動の発生頻度が低下したときは、機械
側で操作者の注意力低下を推測できるため、警報提示の
閾値を安全側に移動させることにより、誤操作や危険の
見落としを予防できる。 （４）飛越眼球運動の発生頻度の低いときは、操作者の
情報処理負荷に余裕があると推測できるため、この時間
を利用して、通常時に提示できない支援的な情報の提示
を自動的に行うことができる。 （５）飛越眼球運動の発生頻度が低いときは、操作者の
情報処理負荷に余裕があると推測できるため、支援的な
情報を積極的に提示することで、操作者の注意力が更に
低下することを防止できる。According to the information presenting apparatus of the present invention, the timing of presenting information automatically changes according to the state of attention of the operator, thereby improving the convenience and safety as described below. it can. (1) By measuring the attention of the operator based on the frequency of the occurrence of jumping eye movements, it is possible to prevent a redundant alarm from being generated when the user is paying sufficient attention to the operation, thereby causing discomfort to the operator. Can be suppressed. (2) When the jumping eye movement increases more than usual, it is estimated that the operator's attention is higher than the normal state and the information processing load of the operator is high. By suppressing the presentation of low-level information, it is possible to prevent the operator from overloading the information processing. (3) When the occurrence frequency of the skipping eye movement decreases, the machine can estimate the decrease in the operator's attention. Therefore, by shifting the threshold value of the warning presentation to the safe side, it is possible to prevent erroneous operation and oversight of danger. . (4) When the frequency of jumping eye movements is low, it can be estimated that there is a margin in the information processing load of the operator. Therefore, this time is used to automatically display supporting information that cannot be normally displayed. It can be carried out. (5) When the frequency of jumping eye movements is low, it can be inferred that the information processing load of the operator has a margin. Therefore, by actively presenting supporting information, the operator's attention is further reduced. Can be prevented.
【図１】本発明に係る情報提示装置の第一実施形態を示
すブロック図である。FIG. 1 is a block diagram showing a first embodiment of an information presentation device according to the present invention.
【図２】図１の情報提示装置の動作の第一例を示す波形
図であり、図２〔１〕は基準パルス信号、図２〔２〕は
飛越眼球運動信号、図２〔３〕は注意力レベル信号であ
る。FIG. 2 is a waveform chart showing a first example of the operation of the information presentation device of FIG. 1, FIG. 2 [1] is a reference pulse signal, FIG. 2 [2] is a skipping eye movement signal, and FIG. 2 [3] is Attention level signal.
【図３】図１の情報提示装置の動作の第二例を示す波形
図であり、図３〔１〕は基準パルス信号、図３〔２〕は
飛越眼球運動信号、図３〔３〕は注意力レベル信号であ
る。3 is a waveform diagram showing a second example of the operation of the information presentation device of FIG. 1, wherein FIG. 3 [1] is a reference pulse signal, FIG. 3 [2] is a skipping eye movement signal, and FIG. 3 [3] is Attention level signal.
【図４】図１の情報提示装置の動作の第三例を示す波形
図であり、図４〔１〕は基準パルス信号、図４〔２〕は
飛越眼球運動信号、図４〔３〕は注意力レベル信号であ
る。FIG. 4 is a waveform chart showing a third example of the operation of the information presentation apparatus of FIG. 1, wherein FIG. 4 [1] is a reference pulse signal, FIG. 4 [2] is a skipping eye movement signal, and FIG. 4 [3] is Attention level signal.
【図５】本発明に係る情報提示装置の第二実施形態を示
すブロック図である。FIG. 5 is a block diagram showing a second embodiment of the information presentation device according to the present invention.
１０，２０ 情報提示装置 １２，２２ 飛越眼球運動検出手段 １４ 注意力判定手段 １６ 各種情報提示手段 Ｍ 操作者 Ｅ 飛越眼球運動 Ａ 飛越眼球運動の発生頻度 Ｂ 注意力レベル Ｃ 情報 10, 20 Information presentation device 12, 22 Jumping eye movement detecting means 14 Attention judgment means 16 Various information presenting means M Operator E Jumping eye movement A Frequency of occurrence of jumping eye movement B Attention level C information
Claims (4)
球運動検出手段と、 この飛越眼球運動検出手段で検出された飛越眼球運動の
発生頻度に基づき、前記操作者の注意力レベルを判定す
る注意力判定手段と、 を備えた注意力測定装置。1. A jumping eye movement detecting means for detecting a jumping eye movement of an operator, and a level of attention of the operator is determined based on an occurrence frequency of the jumping eye movement detected by the jumping eye movement detecting means. An attention measurement device comprising: attention determination means.
低いほど前記注意力レベルが低いと判定する、 請求項１記載の注意力測定装置。2. The attention measurement device according to claim 1, wherein the attention determination unit determines that the attention level is lower as the occurrence frequency is lower.
球運動検出手段と、 この飛越眼球運動検出手段で検出された飛越眼球運動の
発生頻度に基づき、前記操作者の注意力レベルを判定す
る注意力判定手段と、 この注意力判定手段で判定された注意力レベルに基づ
き、各種情報の提示のタイミングを決定する各種情報提
示手段と、 を備えた情報提示装置。3. A jumping eyeball movement detecting means for detecting a jumping eyeball movement of an operator, and a level of attention of the operator is determined based on an occurrence frequency of the jumping eyeball movement detected by the jumping eyeball movement detecting means. An information presenting apparatus comprising: attention determining means; and various information presenting means for determining timing of presenting various information based on the attention level determined by the attention determining means.
低いほど前記注意力レベルが低いと判定し、 前記各種情報提示手段は、前記注意力判定手段で判定さ
れた注意力レベルが低いほど早く情報を提示する、 請求項３記載の情報提示装置。4. The attentiveness determining means determines that the lower the occurrence frequency is, the lower the attentiveness level is, and the various information presenting means determines that the attentiveness level determined by the attentiveness determining means is lower. The information presentation device according to claim 3, wherein the information is presented quickly.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP10100445A JPH11276461A (en) | 1998-03-27 | 1998-03-27 | Attention measuring device and information presenting device using the same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP10100445A JPH11276461A (en) | 1998-03-27 | 1998-03-27 | Attention measuring device and information presenting device using the same |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| JPH11276461A true JPH11276461A (en) | 1999-10-12 |
Family
ID=14274132
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP10100445A Withdrawn JPH11276461A (en) | 1998-03-27 | 1998-03-27 | Attention measuring device and information presenting device using the same |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JPH11276461A (en) |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6699043B2 (en) * | 1996-08-13 | 2004-03-02 | Chi Fai Ho | Learning method and system that consider a student's concentration level |
| JP2005018656A (en) * | 2003-06-27 | 2005-01-20 | Nissan Motor Co Ltd | Driver state detector |
| WO2005069252A1 (en) * | 2004-01-16 | 2005-07-28 | Mario Baccaglini | System method and apparatus for control of purveyance to a user of information with images |
| KR100682104B1 (en) * | 2004-11-04 | 2007-02-12 | 가부시키가이샤 덴소 | A vision recognition support device |
| JP2007507781A (en) * | 2003-09-30 | 2007-03-29 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Motion control for image rendering |
| JP2007293587A (en) * | 2006-04-25 | 2007-11-08 | Toyohashi Univ Of Technology | Method for early detecting change of vigilance and sensing device |
| JP2008035964A (en) * | 2006-08-02 | 2008-02-21 | Toyota Motor Corp | Apparatus and program for determination of sleepiness |
| US7403124B2 (en) | 2005-05-10 | 2008-07-22 | Fuji Jukogyo Kabushiki Kaisha | Driving support equipment for vehicles |
| JP2010005320A (en) * | 2008-06-30 | 2010-01-14 | Isuzu Motors Ltd | Device for determining load on driver |
| JP2010128669A (en) * | 2008-11-26 | 2010-06-10 | Toyota Central R&D Labs Inc | Driving support apparatus and program |
| KR100964600B1 (en) | 2010-04-29 | 2010-06-21 | 주식회사 브레인메딕 | Method for measuring comprehensive attention in continuous performance test |
| JP2011062465A (en) * | 2009-09-18 | 2011-03-31 | Mitsubishi Motors Corp | Driving support device |
| JP2011115450A (en) * | 2009-12-04 | 2011-06-16 | Toyota Central R&D Labs Inc | Apparatus, method, and program for determining aimless state |
| US8333475B2 (en) | 2009-11-12 | 2012-12-18 | Panasonic Corporation | Electro-oculography measuring device, ophthalmological diagnosis device, eye-gaze tracking device, wearable camera, head-mounted display, electronic eyeglasses, electro-oculography measuring method, and recording medium |
| US8421782B2 (en) | 2008-12-16 | 2013-04-16 | Panasonic Corporation | Information displaying apparatus and information displaying method |
| US8419654B2 (en) | 2008-05-20 | 2013-04-16 | Panasonic Corporation | Eye gaze tracking apparatus, imaging apparatus, eye gaze tracking method, program, and integrated circuit |
| US8430510B2 (en) | 2009-11-19 | 2013-04-30 | Panasonic Corporation | Noise reduction device, electro-oculography measuring device, ophthalmological diagnosis device, eye-gaze tracking device, wearable camera, head-mounted display, electronic eyeglasses, noise reduction method, and recording medium |
| JP2013240469A (en) * | 2012-05-21 | 2013-12-05 | Tokyo Institute Of Technology | Device for estimating position of attention |
| JP2015081057A (en) * | 2013-10-24 | 2015-04-27 | 日産自動車株式会社 | Display device for vehicle |
| JP2015207163A (en) * | 2014-04-21 | 2015-11-19 | 株式会社デンソー | State estimation device and state estimation program |
| JP2017023519A (en) * | 2015-07-24 | 2017-02-02 | 株式会社デンソー | State estimation device and state estimation program |
| WO2019171452A1 (en) * | 2018-03-06 | 2019-09-12 | 三菱電機株式会社 | Driving assistance device, driving assistance method, and driving assistance system provided with driving assistance device |
| WO2020152732A1 (en) * | 2019-01-21 | 2020-07-30 | 三菱電機株式会社 | Attentiveness determination apparatus, attentiveness determination system, attentiveness determination method, and program |
| JPWO2020188629A1 (en) * | 2019-03-15 | 2020-09-24 | ||
| US11232385B2 (en) | 2016-11-22 | 2022-01-25 | International Business Machines Corporation | System and method to measure optimal productivity of a person engaged in a task |
-
1998
- 1998-03-27 JP JP10100445A patent/JPH11276461A/en not_active Withdrawn
Cited By (37)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9472116B2 (en) | 1996-08-13 | 2016-10-18 | Iplearn-Focus, Llc | Computing method and system with detached sensor in a network environment |
| US6699043B2 (en) * | 1996-08-13 | 2004-03-02 | Chi Fai Ho | Learning method and system that consider a student's concentration level |
| US8475174B2 (en) | 1996-08-13 | 2013-07-02 | Iplearn-Focus, Llc | Learning method and system using detached sensor |
| US8398407B2 (en) | 1996-08-13 | 2013-03-19 | Iplearn, Llc | Learning method and system in a window environment |
| US8538321B2 (en) | 1996-08-13 | 2013-09-17 | Iplearn-Focus, Llc | Computing method and system using detached sensor |
| US8538320B2 (en) | 1996-08-13 | 2013-09-17 | Iplearn-Focus, Llc | Learning method and system using detached sensor |
| US9123255B2 (en) | 1996-08-13 | 2015-09-01 | Iplearn-Focus, Llc | Computing method and system with detached sensor in a window environment |
| JP2005018656A (en) * | 2003-06-27 | 2005-01-20 | Nissan Motor Co Ltd | Driver state detector |
| JP2007507781A (en) * | 2003-09-30 | 2007-03-29 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Motion control for image rendering |
| WO2005069252A1 (en) * | 2004-01-16 | 2005-07-28 | Mario Baccaglini | System method and apparatus for control of purveyance to a user of information with images |
| CN100364815C (en) * | 2004-11-04 | 2008-01-30 | 株式会社电装 | Vision recognition support device |
| KR100682104B1 (en) * | 2004-11-04 | 2007-02-12 | 가부시키가이샤 덴소 | A vision recognition support device |
| US7403124B2 (en) | 2005-05-10 | 2008-07-22 | Fuji Jukogyo Kabushiki Kaisha | Driving support equipment for vehicles |
| EP2535224A1 (en) | 2005-05-10 | 2012-12-19 | Fuji Jukogyo Kabushiki Kaisha | Driving support equipment for vehicles |
| JP2007293587A (en) * | 2006-04-25 | 2007-11-08 | Toyohashi Univ Of Technology | Method for early detecting change of vigilance and sensing device |
| JP2008035964A (en) * | 2006-08-02 | 2008-02-21 | Toyota Motor Corp | Apparatus and program for determination of sleepiness |
| US8419654B2 (en) | 2008-05-20 | 2013-04-16 | Panasonic Corporation | Eye gaze tracking apparatus, imaging apparatus, eye gaze tracking method, program, and integrated circuit |
| JP2010005320A (en) * | 2008-06-30 | 2010-01-14 | Isuzu Motors Ltd | Device for determining load on driver |
| JP2010128669A (en) * | 2008-11-26 | 2010-06-10 | Toyota Central R&D Labs Inc | Driving support apparatus and program |
| US8421782B2 (en) | 2008-12-16 | 2013-04-16 | Panasonic Corporation | Information displaying apparatus and information displaying method |
| JP2011062465A (en) * | 2009-09-18 | 2011-03-31 | Mitsubishi Motors Corp | Driving support device |
| US8333475B2 (en) | 2009-11-12 | 2012-12-18 | Panasonic Corporation | Electro-oculography measuring device, ophthalmological diagnosis device, eye-gaze tracking device, wearable camera, head-mounted display, electronic eyeglasses, electro-oculography measuring method, and recording medium |
| US8430510B2 (en) | 2009-11-19 | 2013-04-30 | Panasonic Corporation | Noise reduction device, electro-oculography measuring device, ophthalmological diagnosis device, eye-gaze tracking device, wearable camera, head-mounted display, electronic eyeglasses, noise reduction method, and recording medium |
| JP2011115450A (en) * | 2009-12-04 | 2011-06-16 | Toyota Central R&D Labs Inc | Apparatus, method, and program for determining aimless state |
| KR100964600B1 (en) | 2010-04-29 | 2010-06-21 | 주식회사 브레인메딕 | Method for measuring comprehensive attention in continuous performance test |
| JP2013240469A (en) * | 2012-05-21 | 2013-12-05 | Tokyo Institute Of Technology | Device for estimating position of attention |
| JP2015081057A (en) * | 2013-10-24 | 2015-04-27 | 日産自動車株式会社 | Display device for vehicle |
| JP2015207163A (en) * | 2014-04-21 | 2015-11-19 | 株式会社デンソー | State estimation device and state estimation program |
| JP2017023519A (en) * | 2015-07-24 | 2017-02-02 | 株式会社デンソー | State estimation device and state estimation program |
| US11232385B2 (en) | 2016-11-22 | 2022-01-25 | International Business Machines Corporation | System and method to measure optimal productivity of a person engaged in a task |
| WO2019171452A1 (en) * | 2018-03-06 | 2019-09-12 | 三菱電機株式会社 | Driving assistance device, driving assistance method, and driving assistance system provided with driving assistance device |
| WO2020152732A1 (en) * | 2019-01-21 | 2020-07-30 | 三菱電機株式会社 | Attentiveness determination apparatus, attentiveness determination system, attentiveness determination method, and program |
| CN113271852A (en) * | 2019-01-21 | 2021-08-17 | 三菱电机株式会社 | Attention determination device, attention determination system, attention determination method, and program |
| JPWO2020152732A1 (en) * | 2019-01-21 | 2021-09-09 | 三菱電機株式会社 | Attention determination device, attention determination system, attention determination method, and program |
| DE112019006700T5 (en) | 2019-01-21 | 2021-09-30 | Mitsubishi Electric Corporation | ATTENTION DEVICE, ATTENTION SYSTEM, ATTENTION METHOD AND PROGRAM |
| JPWO2020188629A1 (en) * | 2019-03-15 | 2020-09-24 | ||
| WO2020188629A1 (en) * | 2019-03-15 | 2020-09-24 | オムロン株式会社 | Alertness state determination device, awakening system, and alertness state determination method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JPH11276461A (en) | Attention measuring device and information presenting device using the same | |
| JP6699831B2 (en) | Driving awareness estimation device | |
| EP2892036B1 (en) | Alert generation correlating between head mounted imaging data and external device | |
| EP2893867B1 (en) | Detecting visual inattention based on eye convergence | |
| US6262657B1 (en) | Driver alerting system | |
| JP6163017B2 (en) | Portable terminal and danger notification system | |
| US8525654B2 (en) | Vehicle-in-blind-spot detecting apparatus and method thereof | |
| JP5082834B2 (en) | Aside look detection device and method, and program | |
| US8605948B2 (en) | Driver assistance system for monitoring driving safety and corresponding method for detecting and evaluating a vehicle movement | |
| KR20200096782A (en) | Method and system for augmented alarm based on driver condition in hybrid driving | |
| JPH08178712A (en) | Rambling-drive detection apparatus | |
| JP2016110449A (en) | Driving support system and driving support method | |
| JP2020091790A (en) | Automatic operation system | |
| JP2018106240A (en) | Driver state determination device for vehicle | |
| US11198389B1 (en) | Systems and methods for detecting and reducing distracted driving | |
| US9984298B2 (en) | Method for outputting a drowsiness warning and control unit | |
| KR20210113070A (en) | Attention-based notifications | |
| JP2005122390A (en) | Drive support device | |
| JP6169747B2 (en) | Mobile device | |
| JP2007286959A (en) | Operation support device | |
| JP6324262B2 (en) | Safe driving support system | |
| JP2017224066A (en) | Looking aside state determination device | |
| JP2007257302A (en) | Pedestrian portable radio communication terminal | |
| JP2002240660A (en) | Informing device for vehicle | |
| JP2019139609A (en) | Driving support system and driving support method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A300 | Application deemed to be withdrawn because no request for examination was validly filed |
Free format text: JAPANESE INTERMEDIATE CODE: A300 Effective date: 20050607 |