JP2005301727A - Inattention determination apparatus - Google Patents

Inattention determination apparatus Download PDF

Info

Publication number
JP2005301727A
JP2005301727A JP2004117725A JP2004117725A JP2005301727A JP 2005301727 A JP2005301727 A JP 2005301727A JP 2004117725 A JP2004117725 A JP 2004117725A JP 2004117725 A JP2004117725 A JP 2004117725A JP 2005301727 A JP2005301727 A JP 2005301727A
Authority
JP
Japan
Prior art keywords
infrared
driver
reflected
determination
photographing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2004117725A
Other languages
Japanese (ja)
Inventor
Akio Takahashi
昭夫 高橋
Akihito Kimata
亮人 木俣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honda Motor Co Ltd
Original Assignee
Honda Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honda Motor Co Ltd filed Critical Honda Motor Co Ltd
Priority to JP2004117725A priority Critical patent/JP2005301727A/en
Publication of JP2005301727A publication Critical patent/JP2005301727A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

<P>PROBLEM TO BE SOLVED: To provide an inattention determination apparatus promptly detecting the presence or absence of the inattention state of a driver. <P>SOLUTION: An inattention determination section 35 irradiates an infrared ray toward an eyeball of the driver by means of an infrared LED (Light Emitting Diode) interposed at an inattention determination position out of a plurality of infrared LEDs 23<SB>1</SB>-23<SB>n</SB>based on a signal indicative of the light emitting condition of each of the infrared LEDs 23<SB>1</SB>-23<SB>n</SB>and a determination result obtained by an infrared reflection determination section 33. When the infrared reflection determination section 33 determines that the infrared ray is reflected from the eyeglasses of the driver, it is determined that the driver is in the inattention state. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

本発明は、脇見判定装置に関する。   The present invention relates to an armpit determination device.

従来、例えば運転者の顔を撮影するカメラを備え、このカメラの撮影画像に基づき検出される運転者の顔の向きや視線方向と、自車両の走行状態、例えば操舵角等に基づき検出される旋回状態やシフトポジション等に基づき検出される後進状態等に応じて、運転者の顔の向きや視線方向が自車両の前方に向いていなくても良いか否かを判定し、この判定結果に応じて脇見状態の有無を判定する装置が知られている（例えば、特許文献１参照）。
特開平６−２４３３６７号公報 2. Description of the Related Art Conventionally, for example, a camera that captures a driver's face is provided, and is detected based on a driver's face direction and line-of-sight direction detected based on a captured image of the camera and a traveling state of the host vehicle, such as a steering angle. According to the reverse state detected based on the turning state, the shift position, etc., it is determined whether the driver's face direction and line-of-sight direction do not have to face the front of the host vehicle. In response to this, there is known an apparatus that determines the presence or absence of a look-aside state (see, for example, Patent Document 1).
JP-A-6-243367

ところで、上記従来技術においては、カメラにより撮影して得られる撮影画像に対して所定の画像処理および認識処理を行って運転者の顔や眼を検出し、さらに、検出した顔や眼の向きに応じて視線方向を検出するようになっており、カメラによる撮影から運転者の視線が検出されるまでに煩雑な処理が必要であって、検出した視線方向に基づき脇見状態の有無を判定するまでに要する時間が長くなってしまうという問題がある。
本発明は上記事情に鑑みてなされたもので、運転者の脇見状態の有無を迅速に検出することが可能な脇見判定装置を提供することを目的とする。 By the way, in the above-described conventional technology, predetermined image processing and recognition processing are performed on a photographed image obtained by photographing with a camera to detect the face and eyes of the driver, and further, in the detected face and eye orientation. Accordingly, the gaze direction is detected, and complicated processing is required from the shooting by the camera to the detection of the driver's gaze, and until the presence / absence of the look-ahead state is determined based on the detected gaze direction There is a problem that the time required for the process becomes longer.
The present invention has been made in view of the above circumstances, and an object thereof is to provide a side-by-side determination device capable of quickly detecting the presence or absence of a driver's side-by-side state.

上記課題を解決して係る目的を達成するために、請求項１に記載の本発明の脇見判定装置は、自車両の運転者の眼球に互いに異なる照射方向から赤外線を照射する複数の赤外線照射手段（例えば、実施の形態での赤外線発光ダイオード（赤外線ＬＥＤ）２３１，…，２３ｎ）と、前記複数の赤外線照射手段の各作動状態を制御し、赤外線の照射方向を切り換えて照射する照射制御手段（例えば、実施の形態での発光制御部３２）と、自車両の運転者の眼球を赤外線領域にて撮影する赤外線撮影手段（例えば、実施の形態での赤外線カメラ２２）と、前記赤外線撮影手段の撮影により得られる赤外線画像に基づき、前記赤外線照射手段により運転者の眼球に照射された赤外線が運転者の眼鏡で反射した反射赤外線を検出する反射赤外線検出手段（例えば、実施の形態での赤外線反射判定部３３）と、前記反射赤外線検出手段により検出された反射赤外線に基づき運転者の脇見状態の有無を判定する脇見判定手段（例えば、実施の形態での脇見判定部３５）とを備えることを特徴としている。 In order to solve the above-described problems and achieve the object, the side-view determination apparatus according to the present invention includes a plurality of infrared irradiation units that irradiate the driver's eyeball with infrared rays from different irradiation directions. (For example, the infrared light emitting diodes (infrared LEDs) 23 1 ,..., 23 n in the embodiment) and the respective irradiation states of the plurality of infrared irradiation means are controlled, and the irradiation control is performed by switching the irradiation direction of the infrared rays. Means (for example, the light emission control unit 32 in the embodiment), infrared photographing means (for example, the infrared camera 22 in the embodiment) for photographing the eyeball of the driver of the own vehicle in the infrared region, and the infrared photographing. Reflected infrared detection hand for detecting the reflected infrared light reflected by the driver's glasses on the basis of the infrared image obtained by the photographing of the means. A step (e.g., infrared reflection determination unit 33 in the embodiment) and an armpit determination unit (e.g., in the embodiment) that determines the presence or absence of the driver's armpit state based on the reflected infrared ray detected by the reflected infrared detection unit. A side-by-side determination unit 35).

上記構成の脇見判定装置によれば、予め複数の赤外線照射手段を、赤外線照射手段から運転者の眼球に照射された赤外線が脇見状態の運転者の眼鏡により反射され、この反射赤外線が所定位置に配置された赤外線撮影手段により撮影されるような位置に配置しておくことにより、赤外線撮影手段の撮影により得られる赤外線画像において所定の反射赤外線が検出された場合には運転者が脇見状態であると容易に判定することができる。つまり、運転者の眼球や顔の向きから視線を検出し、さらに、この視線の対象物を検出して脇見状態であるか否かを判定する場合に比べて、煩雑な処理を実行する必要なしに迅速に脇見状態の有無を検出することができる。   According to the side-by-side determination device having the above-described configuration, the infrared rays applied to the driver's eyeball from the infrared irradiation unit are reflected by the driver's eyeglasses in the side-by-side state, and the reflected infrared rays are placed at predetermined positions. The driver is in a state of looking aside when a predetermined reflected infrared ray is detected in an infrared image obtained by photographing by the infrared photographing means by being arranged at a position where it is photographed by the arranged infrared photographing means. Can be easily determined. In other words, it is not necessary to perform complicated processing as compared with the case where the line of sight is detected from the direction of the driver's eyeball or face, and further, the object of the line of sight is detected to determine whether or not the person is looking aside. It is possible to quickly detect the presence or absence of a look-aside state.

本発明の脇見判定装置によれば、煩雑な処理を実行する必要なしに迅速に脇見状態の有無を検出することができる。   According to the side-by-side determination device of the present invention, it is possible to quickly detect the presence or absence of a side-by-side state without the need to perform complicated processing.

以下、本発明の一実施形態に係る脇見判定装置について添付図面を参照しながら説明する。
本実施の形態による脇見判定装置１０は、例えば車両の走行安全装置に具備され、図１に示すように、自車両の運転者の視線を検出するためにＣＰＵ等を含む電子回路により構成された検出制御装置１１と、視線センサ１２と、警報装置１３とを備えて構成されている。 Hereinafter, an aside look determination apparatus according to an embodiment of the present invention will be described with reference to the accompanying drawings.
The look-ahead determination device 10 according to the present embodiment is provided in, for example, a vehicle travel safety device, and is configured by an electronic circuit including a CPU and the like to detect the driver's line of sight as shown in FIG. A detection control device 11, a line-of-sight sensor 12, and an alarm device 13 are provided.

視線センサ１２は、例えば図２に示すように、車室内のインストルメントパネルやダッシュボード上部等に設けられ、例えばＣＣＤカメラやＣ−ＭＯＳカメラ等の赤外線領域にて撮影可能な赤外線カメラ２２と、運転者の眼球に向けて互いに異なる方向から赤外線を照射する複数の赤外線発光ダイオード（赤外線ＬＥＤ）２３１，…，２３ｎ（ｎは任意の自然数であって、例えばｎ＝３等）と、赤外線画像処理部２４とを備えて構成されている。
赤外線カメラ２２は、検出制御装置１１の制御により各赤外線ＬＥＤ２３１，…，２３ｎから運転者の眼球に向けて照射された赤外線の反射を撮影する。
赤外線画像処理部２４は、赤外線カメラ２２により撮影して得た赤外線画像に対して、例えばフィルタリングや二値化処理等の所定の画像処理を行い、二次元配列の画素からなる画像データを生成して検出制御装置１１へ出力する。 For example, as shown in FIG. 2, the line-of-sight sensor 12 is provided on an instrument panel, an upper dashboard, or the like in the vehicle interior, and an infrared camera 22 capable of photographing in an infrared region such as a CCD camera or a C-MOS camera, A plurality of infrared light emitting diodes (infrared LEDs) 23 1 ,..., 23 n (n is an arbitrary natural number, for example, n = 3) that irradiates infrared rays toward the driver's eye from different directions, and infrared rays And an image processing unit 24.
The infrared camera 22 photographs the reflection of the infrared rays emitted from the infrared LEDs 23 1 ,..., 23 n toward the driver's eyeballs under the control of the detection control device 11.
The infrared image processing unit 24 performs predetermined image processing such as filtering and binarization processing on the infrared image obtained by photographing with the infrared camera 22 to generate image data including a two-dimensional array of pixels. To the detection control device 11.

検出制御装置１１は、各赤外線ＬＥＤ２３１，…，２３ｎの発光状態を制御する発光制御部３２と、視線センサ１２から赤外線画像の画像データが入力される赤外線反射判定部３３および赤外線視線算出部３４と、脇見判定部３５とを備えて構成されている。 The detection control device 11 includes a light emission control unit 32 that controls the light emission state of each of the infrared LEDs 23 1 ,..., 23 n , an infrared reflection determination unit 33 that receives image data of an infrared image from the line-of-sight sensor 12, and an infrared line-of-sight calculation unit. 34 and an aside look determination unit 35.

発光制御部３２は、複数の赤外線発光ダイオード（赤外線ＬＥＤ）２３１，…，２３ｎの発光状態を制御し、所定の発光順序に応じて赤外線の照射方向を順次切り換えて照射する。そして、各赤外線ＬＥＤ２３１，…，２３ｎの発光状態を示す信号を脇見判定部３５へ出力している。
なお、複数の赤外線ＬＥＤ２３１，…，２３ｎは、例えば自車両の進行方向前方を視線方向とする運転者の眼球に対して適切に赤外線を照射することができる位置に加えて、眼鏡を装着した運転者が脇見状態である場合に運転者の眼球に対して照射した赤外線が眼鏡で反射された反射像が赤外線カメラ２２にて撮影されるような位置（脇見判定位置）に配置されている。すなわち、赤外線カメラ２２の撮影により得られた赤外線画像の画像データにおいて、複数の赤外線ＬＥＤ２３１，…，２３ｎのうちの何れかにより照射された赤外線の反射像が検出された場合には、運転者が脇見状態であると判定することができるように設定されている。 The light emission control unit 32 controls the light emission states of the plurality of infrared light emitting diodes (infrared LEDs) 23 1 ,..., 23 n and irradiates the infrared light by sequentially switching the irradiation direction according to a predetermined light emission order. Each infrared LED 23 1, ..., and outputs a signal indicating a light emission state of 23 n to the inattention determining unit 35.
The plurality of infrared LEDs 23 1 ,..., 23 n are equipped with glasses in addition to a position where the driver's eyeball can be appropriately irradiated with infrared rays, for example, with the forward direction of the host vehicle as the line of sight. When the driver is looking aside, the infrared camera 22 is placed at a position where a reflected image in which the infrared rays irradiated to the driver's eyeballs are reflected by the eyeglasses is photographed (aside look determination position). . That is, when an infrared reflection image irradiated by any one of the plurality of infrared LEDs 23 1 ,..., 23 n is detected in the image data of the infrared image obtained by photographing with the infrared camera 22, the operation is performed. It is set so that the person can determine that the person is looking aside.

赤外線反射判定部３３は、視線センサ１２から入力される赤外線画像の画像データに対して、例えば所定値以上の輝度および大きさを有する領域を検知対象物とした特徴量算出および形状判別等の認識処理を行い、各赤外線ＬＥＤ２３１，…，２３ｎから運転者の眼球に向けて照射される赤外線が運転者の眼鏡で反射されているか否かを判定し、この判定結果を赤外線視線算出部３４および脇見判定部３５へ出力する。この赤外線反射判定部３３による認識処理では、例えば図３（ａ）に示すように、運転者の眼球を撮影した赤外線画像の画像データに対して、所定値以上の輝度および大きさを有する領域を抽出することで、例えば図３（ｂ）に示すような赤外線の各反射像Ｑ１，Ｑ２，Ｑ３を検出する。
赤外線視線算出部３４は、赤外線反射判定部３３にて各赤外線ＬＥＤ２３１，…，２３ｎから運転者の眼球に向けて照射される赤外線が運転者の眼鏡で反射されていないと判定された際に、視線センサ１２から入力される赤外線画像の画像データに対して、例えば運転者の眼球を検知対象物とした特徴量算出および形状判別等の認識処理を行い、認識した検知対象物に基づき、運転者の視線ベクトル（視線方向）を算出し、さらに、この視線ベクトルに基づき、視線の対象位置を算出する。この赤外線視線算出部３４による認識処理では、例えば角膜表面における反射像（プルキニエ像）の中心位置と瞳孔の中心位置との相対距離に基づき視線ベクトルを算出する。 The infrared reflection determination unit 33 recognizes, for example, feature amount calculation and shape determination using, as an object to be detected, an area having brightness and size greater than a predetermined value for image data of an infrared image input from the line-of-sight sensor 12. Processing is performed to determine whether or not the infrared rays emitted from the respective infrared LEDs 23 1 ,..., 23 n toward the driver's eyeballs are reflected by the driver's glasses, and this determination result is used as the infrared line-of-sight calculation unit 34. And output to the aside look determination unit 35. In the recognition processing by the infrared reflection determination unit 33, for example, as shown in FIG. 3A, an area having luminance and size greater than or equal to a predetermined value with respect to image data of an infrared image obtained by photographing a driver's eyeball. By extracting, for example, infrared reflected images Q1, Q2, and Q3 as shown in FIG. 3B are detected.
When the infrared line-of-sight calculation unit 34 determines that the infrared rays irradiated from the respective infrared LEDs 23 1 ,..., 23 n toward the driver's eyeball are not reflected by the driver's glasses. In addition, the image data of the infrared image input from the line-of-sight sensor 12 is subjected to recognition processing such as feature amount calculation and shape determination using the driver's eyeball as a detection target, and based on the recognized detection target, A driver's line-of-sight vector (line-of-sight direction) is calculated, and a target position of the line of sight is calculated based on the line-of-sight vector. In the recognition processing by the infrared line-of-sight calculation unit 34, for example, the line-of-sight vector is calculated based on the relative distance between the center position of the reflected image (Purkinje image) on the cornea surface and the center position of the pupil.

脇見判定部３５は、各赤外線ＬＥＤ２３１，…，２３ｎの発光状態を示す信号と、赤外線反射判定部３３での判定結果とに基づき、運転者が脇見状態であるか否かを判定する。例えば、脇見判定部３５は、複数の赤外線ＬＥＤ２３１，…，２３ｎのうち脇見判定位置に配置された赤外線ＬＥＤにより運転者の眼球に向けて赤外線が照射され、かつ、赤外線反射判定部３３にて運転者の眼鏡で赤外線が反射されたと判定された場合に、運転者が脇見状態であると判定する。そして、脇見判定部３５は、運転者が脇見状態であると判定した場合に警報装置１４を作動させる。 The aside look determination unit 35 determines whether or not the driver is in a look aside based on a signal indicating the light emission state of each of the infrared LEDs 23 1 ,..., 23 n and the determination result in the infrared reflection determination unit 33. For example, inattention determination unit 35, a plurality of infrared LED 23 1, ..., infrared toward the eye of the driver by an infrared LED disposed inattentive determination position of the 23 n is irradiated, and the infrared reflection judgment unit 33 When it is determined that infrared light is reflected by the driver's glasses, the driver determines that the driver is looking aside. And the aside look determination part 35 operates the alarm device 14, when it determines with a driver | operator being in an aside look state.

警報装置１４は、例えば、触覚的伝達装置４１と、視覚的伝達装置４２と、聴覚的伝達装置４３とを備えて構成されている。
触覚的伝達装置４１は、例えばシートベルト装置や操舵制御装置等であって、制御装置１１から入力される制御信号に応じて、例えばシートベルトに所定の張力を発生させて自車両の乗員が触覚的に知覚可能な締め付け力を作用させたり、例えばステアリングホイールに自車両の運転者が触覚的に知覚可能な振動（ステアリング振動）を発生させる。
視覚的伝達装置４２は、例えば表示装置等であって、制御装置１１から入力される制御信号に応じて、例えば表示装置に所定の警報情報を表示したり、所定の警報灯を点滅させる。
聴覚的伝達装置４３は、例えばスピーカ等であって、制御装置１１から入力される制御信号に応じて所定の警報音や音声等を出力する。 The alarm device 14 includes, for example, a tactile transmission device 41, a visual transmission device 42, and an auditory transmission device 43.
The tactile transmission device 41 is, for example, a seat belt device, a steering control device, or the like. The tactile transmission device 41 generates a predetermined tension on the seat belt, for example, in response to a control signal input from the control device 11 so For example, a perceivable tightening force is applied, or vibration (steering vibration) that can be perceived tactilely by the driver of the host vehicle is generated on the steering wheel, for example.
The visual transmission device 42 is, for example, a display device, and displays predetermined alarm information or blinks a predetermined alarm light on the display device, for example, in accordance with a control signal input from the control device 11.
The auditory transmission device 43 is, for example, a speaker or the like, and outputs a predetermined alarm sound, voice, or the like according to a control signal input from the control device 11.

本実施の形態による脇見判定装置１０は上記構成を備えており、次に、この脇見判定装置１０の動作について説明する。   The look-ahead determination device 10 according to the present embodiment has the above-described configuration. Next, the operation of the look-ahead determination device 10 will be described.

例えば図４に示すステップＳ０１においては、所定の発光順序に応じて、複数の赤外線ＬＥＤ２３１，…，２３ｎの発光順序を設定する。
次に、ステップＳ０２においては、設定した発光順序に応じて選択した赤外線ＬＥＤを発光させる。
次に、ステップＳ０３においては、選択した赤外線ＬＥＤにより赤外線を照射した際に赤外線カメラ２２により撮影して得た赤外線画像を取得する。
そして、ステップＳ０４においては、例えば所定値以上の輝度および大きさを有する領域を検知対象物とした特徴量算出および形状判別等の認識処理を行い、運転者の眼球に向けて照射される赤外線が運転者の眼鏡で反射されているか否かを判定する。
この判定結果が「ＹＥＳ」の場合には、後述するステップＳ０６に進む。
一方、この判定結果が「ＮＯ」の場合には、ステップＳ０５に進む。
そして、ステップＳ０５においては、視線センサ１２から入力される赤外線画像の画像データに対して、例えば運転者の眼球を検知対象物とした特徴量算出および形状判別等の認識処理を行い、認識した検知対象物に基づき、運転者の視線ベクトル（視線方向）を算出し、さらに、この視線ベクトルに基づき、視線の対象位置を算出し、一連の処理を終了する。 For example, in step S01 shown in FIG. 4, the light emission order of the plurality of infrared LEDs 23 1 ,..., 23 n is set according to a predetermined light emission order.
Next, in step S02, the infrared LED selected according to the set light emission order is caused to emit light.
Next, in step S03, an infrared image obtained by photographing with the infrared camera 22 when infrared rays are irradiated by the selected infrared LED is acquired.
In step S04, for example, recognition processing such as feature amount calculation and shape determination using a region having luminance and size greater than or equal to a predetermined value as a detection target is performed, and infrared rays emitted toward the driver's eyeball are emitted. It is determined whether or not the light is reflected by the driver's glasses.
If this determination is “YES”, the flow proceeds to step S 06 described later.
On the other hand, if this determination is “NO”, the flow proceeds to step S 05.
In step S05, recognition processing such as feature amount calculation and shape determination using, for example, the driver's eyeball as the detection target is performed on the image data of the infrared image input from the line-of-sight sensor 12, and the detected detection is performed. Based on the object, the driver's line-of-sight vector (line-of-sight direction) is calculated, and further, the line-of-sight target position is calculated based on the line-of-sight vector, and the series of processing ends.

また、ステップＳ０６においては、各赤外線ＬＥＤ２３１，…，２３ｎの発光状態を示す信号と、赤外線反射判定部３３での判定結果とに基づき、運転者が脇見状態であるか否かを判定する。
そして、ステップＳ０７においては、運転者が脇見状態であると判定されたか否かを判定する。
この判定結果が「ＮＯ」の場合には、一連の処理を終了する。
一方、この判定結果が「ＹＥＳ」の場合には、警報装置１４を作動させ、一連の処理を終了する。 Further, in step S06, it is determined whether or not the driver is in an aside state based on the signal indicating the light emission state of each infrared LED 23 1 ,..., 23 n and the determination result in the infrared reflection determination unit 33. .
In step S07, it is determined whether or not the driver is determined to be looking aside.
When the determination result is “NO”, the series of processes is terminated.
On the other hand, when the determination result is “YES”, the alarm device 14 is activated, and the series of processing ends.

上述したように、本実施の形態による脇見判定装置１０によれば、複数の赤外線ＬＥＤ２３１，…，２３ｎのうち脇見判定位置に配置された赤外線ＬＥＤにより運転者の眼球に向けて赤外線が照射され、かつ、赤外線反射判定部３３にて運転者の眼鏡で赤外線が反射されたと判定された場合に、運転者が脇見状態であると判定することにより、単純な判定処理によって運転者の脇見状態を適切かつ迅速に検出することができる。 As described above, according to the inattention determining apparatus 10 according to this embodiment, a plurality of infrared LED 23 1, ..., infrared irradiation toward the eye of the driver by an infrared LED disposed inattentive determination position of the 23 n When the infrared reflection determination unit 33 determines that the infrared light is reflected by the driver's glasses, it is determined that the driver is in a side-by-side state. Can be detected appropriately and quickly.

本発明の一実施形態に係る視線検出装置の構成図である。It is a lineblock diagram of a gaze detection device concerning one embodiment of the present invention. 図１に示す視線センサを搭載した車両を示す斜視図である。It is a perspective view which shows the vehicle carrying the gaze sensor shown in FIG. 運転者の眼鏡で反射される赤外線の反射像の一例を示す図である。It is a figure which shows an example of the infrared reflected image reflected with a driver | operator's spectacles. 図１に示す視線検出装置の動作を示すフローチャートである。It is a flowchart which shows operation | movement of the gaze detection apparatus shown in FIG.

符号の説明Explanation of symbols

１０ 脇見判定装置
２２ 赤外線カメラ（赤外線撮影手段）
２３１，…，２３ｎ 赤外線発光ダイオード（赤外線照射手段）
３２ 発光制御部（照射制御手段）
３３ 赤外線反射判定部（反射赤外線検出手段）
３４ 赤外線視線算出部
３５ 脇見判定部（脇見判定手段）

10 Wakimi determination device 22 Infrared camera (infrared imaging means)
23 1 ,..., 23 n Infrared light emitting diode (infrared irradiation means)
32 Light emission control unit (irradiation control means)
33 Infrared reflection determination unit (reflected infrared detection means)
34 Infrared line-of-sight calculation unit 35 Aside look determination unit (aside look determination means)

Claims (1)

自車両の運転者の眼球に互いに異なる照射方向から赤外線を照射する複数の赤外線照射手段と、
前記複数の赤外線照射手段の各作動状態を制御し、赤外線の照射方向を切り換えて照射する照射制御手段と、
自車両の運転者の眼球を赤外線領域にて撮影する赤外線撮影手段と、
前記赤外線撮影手段の撮影により得られる赤外線画像に基づき、前記赤外線照射手段により運転者の眼球に照射された赤外線が運転者の眼鏡で反射した反射赤外線を検出する反射赤外線検出手段と、
前記反射赤外線検出手段により検出された反射赤外線に基づき運転者の脇見状態の有無を判定する脇見判定手段と
を備えることを特徴とする脇見判定装置。

A plurality of infrared irradiation means for irradiating the eyeball of the driver of the own vehicle with infrared rays from different irradiation directions;
Irradiation control means for controlling each operating state of the plurality of infrared irradiation means, and switching and irradiating the infrared irradiation direction;
An infrared photographing means for photographing an eyeball of a driver of the own vehicle in an infrared region;
Based on an infrared image obtained by photographing by the infrared photographing means, a reflected infrared detecting means for detecting a reflected infrared ray reflected on the driver's eyeglasses by infrared rays irradiated on the driver's eyeball by the infrared irradiation means;
An aside look determination device comprising: a look aside determination means for determining the presence or absence of a driver's look aside based on the reflected infrared light detected by the reflected infrared detection means.

JP2004117725A 2004-04-13 2004-04-13 Inattention determination apparatus Pending JP2005301727A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2004117725A JP2005301727A (en) 2004-04-13 2004-04-13 Inattention determination apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2004117725A JP2005301727A (en) 2004-04-13 2004-04-13 Inattention determination apparatus

Publications (1)

Publication Number Publication Date
JP2005301727A true JP2005301727A (en) 2005-10-27

Family

ID=35333175

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2004117725A Pending JP2005301727A (en) 2004-04-13 2004-04-13 Inattention determination apparatus

Country Status (1)

Country Link
JP (1) JP2005301727A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009143279A (en) * 2007-12-11 2009-07-02 Mazda Motor Corp Vehicle-mounted equipment controller
KR20180038316A (en) * 2016-10-06 2018-04-16 현대자동차주식회사 Apparatus and method for determining condition of driver

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07159317A (en) * 1993-12-06 1995-06-23 Nissan Motor Co Ltd Line of sight direction detection apparatus for vehicle
JPH07218989A (en) * 1994-02-04 1995-08-18 Mitsubishi Electric Corp Face image photographing device
JPH08185503A (en) * 1994-12-27 1996-07-16 Mitsubishi Electric Corp Image processor

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07159317A (en) * 1993-12-06 1995-06-23 Nissan Motor Co Ltd Line of sight direction detection apparatus for vehicle
JPH07218989A (en) * 1994-02-04 1995-08-18 Mitsubishi Electric Corp Face image photographing device
JPH08185503A (en) * 1994-12-27 1996-07-16 Mitsubishi Electric Corp Image processor

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009143279A (en) * 2007-12-11 2009-07-02 Mazda Motor Corp Vehicle-mounted equipment controller
KR20180038316A (en) * 2016-10-06 2018-04-16 현대자동차주식회사 Apparatus and method for determining condition of driver
KR102371591B1 (en) * 2016-10-06 2022-03-07 현대자동차주식회사 Apparatus and method for determining condition of driver

Similar Documents

Publication Publication Date Title
JP6497158B2 (en) Display device, moving body
JP4497305B2 (en) Driver status determination device
JP6454368B2 (en) Vehicle display system and method for controlling vehicle display system
KR101205039B1 (en) Safe eye detection
JP6617662B2 (en) Gaze detection device, gaze detection method, and computer program
US20150238087A1 (en) Biological information measurement device and input device utilizing same
JP5576134B2 (en) Wakimi alarm device
JP6346525B2 (en) Gaze detection device
WO2017090319A1 (en) Device for detecting direction of line of sight, and system for detecting direction of line of sight
JP2007004448A (en) Line-of-sight detecting apparatus
JP6651911B2 (en) Face image processing device
TWI522257B (en) Vehicle safety system and operating method thereof
JP6433383B2 (en) Floodlight device
JP4313717B2 (en) Gaze detection device
CN113316805A (en) Method and system for monitoring a person using infrared and visible light
KR20170135573A (en) Apparatus for detecting of driver gaze direction
JP6360752B2 (en) Illumination imaging device
JP4451195B2 (en) Gaze detection device
US11810372B2 (en) Multiple in-cabin cameras and lighting sources for driver monitoring
JP2005301727A (en) Inattention determination apparatus
JP2018190213A (en) Face recognition device and sight line detection device
JP2019146915A (en) Evaluation device, evaluation method, and evaluation program
JP2020024750A (en) Line-of-sight detection device, line-of-sight detection method, and computer program
JP2010026657A (en) Driver state detection device
JP2018181025A (en) Sight line detecting device

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20061128

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20091124

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20100330