JP6538203B2 - Electro-oculogram calibration device, eyeglass-type electronic device, electro-oculogram calibration method and program - Google Patents

Electro-oculogram calibration device, eyeglass-type electronic device, electro-oculogram calibration method and program Download PDF

Info

Publication number
JP6538203B2
JP6538203B2 JP2017561576A JP2017561576A JP6538203B2 JP 6538203 B2 JP6538203 B2 JP 6538203B2 JP 2017561576 A JP2017561576 A JP 2017561576A JP 2017561576 A JP2017561576 A JP 2017561576A JP 6538203 B2 JP6538203 B2 JP 6538203B2
Authority
JP
Japan
Prior art keywords
eye
potential
movement
electro
oculogram
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017561576A
Other languages
Japanese (ja)
Other versions
JPWO2017122533A1 (en
Inventor
誠治 時田
誠治 時田
高井　大輔
大輔 高井
山田　幸光
幸光 山田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alps Alpine Co Ltd
Original Assignee
Alps Electric Co Ltd
Alps Alpine Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alps Electric Co Ltd, Alps Alpine Co Ltd filed Critical Alps Electric Co Ltd
Publication of JPWO2017122533A1 publication Critical patent/JPWO2017122533A1/en
Application granted granted Critical
Publication of JP6538203B2 publication Critical patent/JP6538203B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/25—Bioelectric electrodes therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/25—Bioelectric electrodes therefor
    • A61B5/279—Bioelectric electrodes therefor specially adapted for particular uses
    • A61B5/291—Bioelectric electrodes therefor specially adapted for particular uses for electroencephalography [EEG]

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Pathology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Eye Examination Apparatus (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Description

本発明は、人体の皮膚に接触して眼電位をキャリブレーションする眼電位キャリブレーション装置、眼鏡型電子機器、眼電位キャリブレーション方法およびプログラムに関するものである。   The present invention relates to an electro-oculogram calibration device, an eyeglass-type electronic device, an electro-oculogram calibration method, and a program for calibrating the eye potential by contacting the skin of a human body.

近年、スマートフォンやゲーム機に代表される携帯型電子機器を発展させ、人体に直接着けて使用できる小型の電子機器（「ウエラブル」とも呼ばれている）が注目を集めている。特に、人体の頭部に眼鏡フレームを装着使用する眼鏡型電子機器は、日常の活動を妨げることなく、瞬き情報や視線情報等の人体の情報を得るのに適している。   2. Description of the Related Art In recent years, small-sized electronic devices (also referred to as “Wearables”) that can be used by being directly worn on the human body have been attracting attention, with the development of portable electronic devices represented by smartphones and game machines. In particular, a spectacles-type electronic device in which a spectacles frame is mounted on the head of a human body is suitable for obtaining information on the human body such as blink information and line-of-sight information without interrupting daily activities.

人体の精神活動や体調の状態を示すパラメータとして、皮膚電気活動（Electro Dermal Activity）が知られている。
この人体の皮膚電気活動は人体の皮膚の電位を検出することで把握でき、これら電位検出を使って様々な生体情報を得ることができる。Electro Dermal Activity is known as a parameter indicating the mental activity and physical condition of the human body.
The skin electrical activity of the human body can be grasped by detecting the potential of the skin of the human body, and various biological information can be obtained using the potential detection.

特に、眼球の動きから疲れや眠気を可視化するための眼電位センシングの技術、すなわち眼電位（EOG、Electro Oculo Graphy）を用いた視線等の検出技術が知られている。
眼電位とは、眼球の角膜側と網膜側との間に生じている数十mVの電位差を示す。人間の眼球の角膜側は、一般に正の電荷、網膜側は負の電荷を帯びているため、両者の間に電位差が発生する。目の周囲の皮膚に電極を付けて電位差を測定すると、目の動きや瞬きによってこの電位が変わる。眼電位センシングとは、このような電位差測定である。視線や心理状態、疲労などの推定に役立つ。In particular, a technique of electro-oculogram sensing for visualizing fatigue and sleepiness from movement of eyeballs, that is, a detection technique of a gaze using an electro-oculogram (EOG, Electro Oculo Graphy) is known.
The eye potential indicates a potential difference of several tens of mV occurring between the corneal side and the retinal side of the eye. Since the cornea side of the human eye is generally positively charged and the retina side is negatively charged, a potential difference is generated between the two. When an electrode is attached to the skin around the eye and the potential difference is measured, this potential changes due to eye movements and blinks. Intraocular potential sensing is such a potentiometric measurement. It is useful for estimating gaze, mental state, fatigue, etc.

特開２０１４−１８２３４Japanese Patent Application Publication No. 2014-18234

ところで、人体の頭部の形状、又は前記眼鏡型電子機器の眼鏡型フレームの頭部への装着の仕方によっては使用者の眼球の位置又は眼電位を検出する電極の位置が異なる。この眼球の位置、電極の位置の相違によって、検出される眼電位は異なり、眼電位に個人差が生じる。   By the way, depending on the shape of the head of the human body or the manner of attaching the glasses-type electronic device to the head of the spectacles-type frame, the position of the eye of the user or the position of the electrode for detecting the eye potential differs. Due to the difference in the position of the eyeball and the position of the electrode, the detected eye potential is different, and an individual difference occurs in the eye potential.

眼電位に個人差が生じると、瞬き又は視線等に関する眼電位の検出レベルの最適化ができないため検出誤差が大きくなる可能性がある。 If individual differences occur in the eye potential, the detection error may become large because the detection level of the eye potential related to blinking or sight line can not be optimized.

本発明はかかる事情に鑑みてなされたものであり、その目的は、眼鏡型電子機器の使用者の使用態様に応じて眼電位をキャリブレーションすることで、眼電位の検出レベルの最適化を行うことにより、眼電位の検出誤差を少なくすることを目的とする。 The present invention has been made in view of such circumstances, and its object is to optimize the detection level of the electrooculogram by calibrating the electrooculogram according to the usage mode of the user of the spectacles-type electronic device. It is an object of the present invention to reduce the detection error of the ocular potential.

上述した問題点を解決し、上述した目的を達成するために、本発明は眼球の動きを検出する眼球動き検出手段と、眼電位を検出する眼電位検出手段と、前記眼球動き検出手段の検出結果に応じて検出される前記眼電位検出手段の検出結果を基に、眼電位をキャリブレーションするキャリブレーション手段とを有してなる。   In order to solve the above-mentioned problems and achieve the above-mentioned object, the present invention is an eye movement detecting means for detecting movement of an eye, an electrooculogram detecting means for detecting eye potential, and detection of the eye movement detecting means And calibration means for calibrating the ocular potential based on the detection result of the ocular potential detecting means detected according to the result.

この構成によれば、予め眼鏡型電子機器の使用者の眼球の位置又は眼電位を検出する電極の位置に応じて眼電位をキャリブレーションすることができるので、使用者の眼電位パラメータを決定でき、眼電位の検出レベルの最適化を行うことができる。そして、使用時の眼電位の検出誤差を少なくすることができる。   According to this configuration, since the eye potential can be calibrated in advance according to the position of the eye of the user of the eyeglass-type electronic device or the position of the electrode detecting the eye potential, the eye potential parameter of the user can be determined. And optimization of the detection level of the eye potential. And the detection error of the electro-oculogram at the time of use can be decreased.

また、本発明は眼球の動きを検出する眼球動き検出手段と、眼電位を検出する眼電位検出手段と、前記眼球動き検出手段の検出結果に応じて検出される前記眼電位検出手段の検出結果を基に、眼電位をキャリブレーションするキャリブレーション手段とを有する眼電位キャリブレーション装置であって、人体の眼球に予め決められた動きを行わせるための眼球動かし手段を有してなる。   Further, according to the present invention, the detection result of the eye potential detection means detected according to the detection result of the eye movement detection means for detecting the movement of the eye ball, the eye potential detection means for detecting the eye potential, and the eye movement detection means And a calibration means for calibrating the eye potential, and the eye movement means for causing the eye of the human body to perform a predetermined movement.

上記構成によれば、人体の眼球に予め決められた動きを行わせるので、案内に添って眼球を動かせば良い。そして、予め眼鏡型電子機器の使用者の眼球の位置又は眼電位を検出する電極の位置に応じて眼電位をキャリブレーションすることができるので、眼電位の検出レベルの最適化を行うことができ、眼電位の検出誤差を少なくすることができる。   According to the above configuration, since the eyeball of the human body is caused to perform a predetermined movement, the eyeball may be moved along the guide. Then, since the ocular potential can be calibrated in advance according to the position of the eyeball of the user of the spectacles-type electronic device or the position of the electrode detecting the ocular potential, the detection level of the ocular potential can be optimized. The detection error of the electro-oculogram can be reduced.

好適には、前記眼球動かし手段は、眼球を表示するディスプレイ上で眼球を動かすための着目点の表示を行う。
この構成によれば、眼電位をキャリブレーションするための眼球の基準点を設定できる。Preferably, the eye movement means displays a point of interest for moving the eye on a display for displaying the eye.
According to this configuration, it is possible to set the reference point of the eyeball for calibrating the eye potential.

好適には、前記眼球動かし手段は、前記ディスプレイ上に、眼球を動かす案内表示を行う。
この構成によれば、眼鏡型電子機器の使用者の眼球の動きを規定方向に案内することができ、前記眼球動き検出手段の検出精度を向上させることができる。Preferably, the eye movement means provides guidance display for moving the eye on the display.
According to this configuration, it is possible to guide the movement of the eyeball of the user of the glasses-type electronic device in a prescribed direction, and to improve the detection accuracy of the eyeball movement detection means.

好適には、前記眼球動かし手段は、眼球に予め決められた角度の動きを行わせ、前記眼球動き検出手段は、前記眼球動かし手段に応じて前記眼球が動いた角度を検出する。
この構成によれば、眼鏡型電子機器の使用者の眼球の動く角度により眼球の位置を検出し、眼電位をキャリブレーションすることができ、眼電位の最適化を図ることができる。Preferably, the eye movement means causes the eye to move at a predetermined angle, and the eye movement detection means detects an angle at which the eye has moved according to the eye movement means.
According to this configuration, it is possible to detect the position of the eyeball by the movement angle of the eyeball of the user of the glasses-type electronic device, to calibrate the eye potential, and to optimize the eye potential.

好適には、前記眼球動き検出手段は、カメラで眼球を撮像して得た画像データを基に眼球の動きを検出する。
この構成によれば、予め眼電位をキャリブレーションするための眼球の基準点を設定できる。Preferably, the eye movement detection means detects the movement of the eye based on image data obtained by imaging the eye with a camera.
According to this configuration, it is possible to set in advance the reference point of the eyeball for calibrating the electro-oculogram.

本発明の眼鏡型電子機器は、前記眼電位キャリブレーション装置を備えてなる。
この構成によれば、上述したように予め眼鏡型電子機器の使用者の眼球の位置又は眼電位を検出する電極の位置に応じて眼電位をキャリブレーションすることができるので、使用者の眼電位パラメータを決定でき、眼電位の検出レベルの最適化を行うことができる。そして、使用時の眼電位の検出誤差を少なくすることができるので、高精度の眼電位キャリブレーション装置を備えた眼鏡型電子機器を提供できる。The spectacles-type electronic device of the present invention comprises the above-mentioned electrooculogram calibration device.
According to this configuration, as described above, the eye potential can be calibrated in advance according to the position of the eye of the user of the glasses-type electronic device or the position of the electrode for detecting the eye potential. Parameters can be determined and optimization of the detection level of the eye potential can be performed. And since the detection error of the eye potential at the time of use can be reduced, the spectacles-type electronic device provided with the highly accurate eye potential calibration apparatus can be provided.

本発明はコンピュータが眼電位をキャリブレーションする方法であって、眼球の動きを検出する眼球動き検出ステップと、眼電位を検出する眼電位検出ステップと、前記眼球動き検出ステップの検出結果に応じて検出される前記眼電位検出ステップの検出結果を基に、眼電位をキャリブレーションするキャリブレーションステップとを有する。
この方法によれば、精度よく眼電位のキャリブレーションを行うことができる。The present invention is a method in which a computer calibrates an eye potential, and according to detection results of an eye movement detecting step of detecting a movement of an eye, an eye potential detecting step of detecting an eye potential, and the eye movement detecting step. And calibration step of calibrating the ocular potential based on the detection result of the ocular potential detecting step to be detected.
According to this method, calibration of the electro-oculogram can be performed with high accuracy.

好適には、人体の眼球に予め決められた動きを行わせるための眼球動かしステップを有する。
この方法によれば、眼球の動きを案内することができ眼電位のキャリブレーションの精度を高めることができる。Preferably, there is an eye movement step for causing the eye of the human body to perform a predetermined movement.
According to this method, the movement of the eyeball can be guided, and the accuracy of calibration of the electrooculogram can be enhanced.

本発明のプログラムによれば、眼電位のキャリブレーションを高精度に行うことができる。 According to the program of the present invention, calibration of the electrooculogram can be performed with high accuracy.

本発明によれば、予め眼鏡型電子機器の使用者の眼球の位置又は眼電位を検出する電極の位置に応じて眼電位をキャリブレーションすることができるので、使用者の眼電位パラメータを決定でき、眼電位の検出レベルの最適化を行うことがきる。そして、使用時の眼電位の検出誤差を少なくすることができる。 According to the present invention, since the eye potential can be calibrated in accordance with the position of the eye of the user of the eyeglass-type electronic device or the position of the electrode detecting the eye potential, the eye potential parameter of the user can be determined It is possible to optimize the detection level of the electro-oculogram. And the detection error of the electro-oculogram at the time of use can be decreased.

本発明の実施形態に係る眼電位キャリブレーション装置が組み込まれた眼鏡型電子機器の外観斜視図である。FIG. 1 is an external perspective view of a glasses-type electronic device in which an electro-oculogram calibration device according to an embodiment of the present invention is incorporated. 図1に示す眼鏡型電子機器の鼻パッド部分を示す拡大斜視図である。It is an expansion perspective view which shows the nose pad part of the spectacles type electronic device shown in FIG. 図１に示す眼電位キャリブレーション装置を説明するためのブロック図である。It is a block diagram for demonstrating the electro-oculogram calibration apparatus shown in FIG. 図３に示す眼球キャリブレーション装置の動作（眼電位キャリブレーション方法）を説明するためのフローチャートである。It is a flowchart for demonstrating the operation | movement (eye potential calibration method) of the eyeball calibration apparatus shown in FIG.

以下、本発明の実施形態に係る眼電位キャリブレーション装置２０について説明する。
図１は、本発明の実施形態に係る眼電位キャリブレーション装置２０が組み込まれた眼鏡型電子機器１の外観斜視図であり、眼鏡フレーム２は使用者の耳に掛けられる一対のテンプル部３Ａ、３Ｂと、レンズ４、４が取り付けられた一対のリム部５、５と、これらリム部５、５の間に介在するブリッジ部６とを有する。
また、テンプル部３Ａ、３Bとリム部５、５との間にはヒンジ部７、７が設けられており、テンプル部３Ａ、３Ｂはヒンジ部７、７を介してリム部５、５に対して折り畳み自在に構成されている。Hereinafter, an electro-oculogram calibration device 20 according to an embodiment of the present invention will be described.
FIG. 1 is an external perspective view of an eyeglass-type electronic device 1 in which an electro-oculogram calibration device 20 according to an embodiment of the present invention is incorporated, and an eyeglass frame 2 is a pair of temple portions 3A hooked on a user's ear 3B, a pair of rim portions 5 and 5 to which the lenses 4 and 4 are attached, and a bridge portion 6 interposed between the rim portions 5 and 5.
In addition, hinges 7, 7 are provided between the temples 3A, 3B and the rims 5, 5, and the temples 3A, 3B are provided to the rims 5, 5 via the hinges 7, 7. It is configured to be foldable.

図２にも示すように、眼鏡フレーム２のブリッジ部６には一対の鼻パッド８Ａ、８Ｂが設けられている。この鼻パッド８Ａ、８Ｂの表面には後述する眼電位検出手段１０を構成する第1の電極１１と第２の電極１２が設けられている。第1の電極１１は使用者の右眼の眼電位を検出する。第２の電極１２は使用者の左眼の眼電位を検出する。   As also shown in FIG. 2, the bridge portion 6 of the eyeglass frame 2 is provided with a pair of nose pads 8A and 8B. On surfaces of the nose pads 8A and 8B, a first electrode 11 and a second electrode 12 which constitute an eye potential detection means 10 described later are provided. The first electrode 11 detects the eye potential of the right eye of the user. The second electrode 12 detects the eye potential of the left eye of the user.

眼電位とは、眼球の角膜側と網膜側との間に生じている数十mVの電位差を示す。人間の眼球の角膜側は、一般に正の電荷、網膜側は負の電荷を帯びているため、両者の間に電位差が発生する。目の周囲の皮膚に電極を付けて電位差を測定すると、目の動きや瞬きによってこの電位が変わる。このような電位差測定を眼電位センシングという。この眼電位センシング技術は瞬きや眼球の動きから疲れや眠気を可視化することができ、視線や心理状態、疲労などの推定に役立つ。 The eye potential indicates a potential difference of several tens of mV occurring between the corneal side and the retinal side of the eye. Since the cornea side of the human eye is generally positively charged and the retina side is negatively charged, a potential difference is generated between the two. When an electrode is attached to the skin around the eye and the potential difference is measured, this potential changes due to eye movements and blinks. Such potential difference measurement is called electro-oculogram sensing. This eye potential sensing technology can visualize fatigue and drowsiness from blinks and eye movement, and is useful for estimating gaze, mental state, fatigue, etc.

眼電位検出部１０を構成する電極１１，１２は眼鏡フレーム２のテンプル部３Ａに組み込まれた図示しない配線を介してテンプル部３Ａの先端側のモダン内に設けた図示しない眼鏡電位検出回路に出力される。
眼電位検出回路は眼電位キャリブレーション装置２０のキャリブレーション部３０に接続されている。The electrodes 11 and 12 constituting the eye potential detection unit 10 are output to a not-shown eyeglass potential detection circuit provided in the modern on the tip side of the temple portion 3A through a not-shown wire incorporated in the temple portion 3A of the eyeglass frame 2 Be done.
The electro-oculogram detection circuit is connected to the calibration unit 30 of the electro-oculogram calibration device 20.

図３にも示すように、眼電位キャリブレーション装置２０は人体の眼球に予め決められた動きを行わせるための眼球動かし部４０と、眼球動かし部４０に応じた眼球の動きを検出する眼球動き検出部５０と、眼電位を検出する眼電位検出部１０と、前記眼球動き検出部５０の検出結果に応じて検出される眼電位検出部１０の検出結果を基に、眼電位をキャリブレーションする眼電位キャリブレーション部３０とを有する。 As also shown in FIG. 3, the eye potential calibration device 20 detects the eye movement according to the eye movement unit 40 for causing the eye of the human body to perform a predetermined movement and the eye movement according to the eye movement unit 40. Calibrate the ocular potential based on the detection results of the detection unit 50, the ocular potential detection unit 10 that detects the ocular potential, and the ocular potential detection unit 10 that is detected according to the detection result of the eye movement detection unit 50 And an eye potential calibration unit 30.

眼球動かし部４０は、例えば携帯型電子機器であるスマートフォン等に設けたデイス
プレイ４１上で表示された眼球を動かすための着目点の表示を行う構成を備えている。The eyeball moving unit 40 has a configuration for displaying a focused point for moving the eyeball displayed on the display 41 provided on, for example, a smartphone as a portable electronic device.

また、眼球動かし部４０は、ディスプレイ４１上に、眼球を動かす案内表示を行う構成も備えている。   In addition, the eyeball moving unit 40 also has a configuration for performing guidance display for moving the eyeball on the display 41.

眼電位キャリブレーション装置２０の動作（眼電位キャリブレーション方法）について、図４に従い説明する。   The operation (eye potential calibration method) of the eye potential calibration device 20 will be described according to FIG.

ステップＳＴ１１：
デイスプレイ４１上に表示された眼球動かし手段４０を構成する着目点を目視する。そして、デイスプレイ４１上に表示された案内表示に沿って眼球を動かす。Step ST11:
The point of interest constituting the eyeball moving means 40 displayed on the display 41 is visually observed. Then, the eyeball is moved along the guidance display displayed on the display 41.

ステップＳＴ１２：
この眼球の動きを眼球動き検出部５０が検出し、この検出結果を眼電位検出部１０に送る。Step ST12:
The eye movement detection unit 50 detects the movement of the eye, and sends the detection result to the eye potential detection unit 10.

ステップＳＴ１３；
眼電位検出部１０で眼電位を検出する。Step ST13;
The eye potential detection unit 10 detects the eye potential.

ステップＳＴ１４：
眼電位検出部１０の検出結果を基に、眼電位をキャリブレーションするキャリブレーション部２０に送り、眼電位をキャリブレーションする。Step ST14:
Based on the detection result of the electro-oculogram detection unit 10, the electro-oculogram is sent to a calibration unit 20 that calibrates the electro-oculogram to calibrate the electro-oculogram.

このように、予め眼鏡型電子機器の使用者の眼球の位置又は眼電位を検出する電極の位置に応じて眼電位をキャリブレーションすることができるので、予め使用者の眼電位パラメータを決定でき、眼電位の検出レベルの最適化を行うことができる。そして、使用時の眼電位の検出誤差を少なくすることができる。 As described above, since the eye potential can be calibrated in accordance with the position of the eye of the user of the eyeglass-type electronic device or the position of the electrode for detecting the eye potential, the eye potential parameter of the user can be determined in advance Optimization of the detection level of the eye potential can be performed. And the detection error of the electro-oculogram at the time of use can be decreased.

なお、本発明の眼球動かし手段は、眼球に予め決められた角度の動きを行わせ、眼球動き検出手段は前記眼球動かし手段に応じて眼球が動いた角度を検出するようにしても良い。
この構成の場合、使用者の眼球の動く角度により眼球の位置を検出し、眼電位をキャリブレーションすることができ、眼電位の最適化を図ることができる。The eyeball moving means of the present invention may cause the eyeball to move at a predetermined angle, and the eyeball movement detecting means may detect the angle at which the eyeball moved according to the eyeball moving means.
In this configuration, the position of the eyeball can be detected based on the movement angle of the user's eyeball, the eye potential can be calibrated, and the eye potential can be optimized.

また、本発明の眼球動き検出手段は、予めカメラで眼球を撮像して得られた画像データを基に眼球の動きを検出するようにしても良い。   Further, the eye movement detection means of the present invention may detect the movement of the eye based on image data obtained by imaging the eye with a camera in advance.

また、本発明は、使用者が一点を見て首を動かし、角速度センサで動かした首の角度を検出し、眼電位をキャリブレーションするようにしても良い。この場合、予め眼球を動かすための眼球動かし手段が不要となり、単に首を振る動作と眼線を送る動作で眼球の動きを検知することができる。 Further, in the present invention, the user may move the neck at one point, and the angular velocity sensor may detect the angle of the moved neck to calibrate the electrooculogram. In this case, the eye movement means for moving the eye is not necessary in advance, and the movement of the eye can be detected simply by the action of shaking the neck and the action of sending the eye line.

本発明では、眼電位のキャリブレーション装置２０を動作させる信号処理部の各部の機能は、処理回路でプログラムを実行して実現してもよいし、少なくとも一部の機能をハードウエアで実現してもよい。 In the present invention, the functions of the respective units of the signal processing unit for operating the calibration apparatus 20 for ocular potential may be realized by executing a program by the processing circuit, or at least a part of the functions are realized by hardware. It is also good.

本発明は上述した実施形態に限定されない。すなわち、当業者は、本発明の技術的範囲又はその均等の範囲内において、上述した実施形態の構成に関し、様々な変更、コンビネーション、並びに代替を行ってもよい。 The present invention is not limited to the embodiments described above. That is, those skilled in the art may make various modifications, combinations, and substitutions within the technical scope of the present invention or the equivalent thereof regarding the configuration of the above-described embodiment.

本発明の眼電位センシング技術を利用した電子機器ならばその用途は幅広く、自動車の運転補助、歩行の補助等の機器への適用が可能である。   The electronic device using the electro-oculogram sensing technology of the present invention has a wide range of applications, and can be applied to devices such as driving assistance for vehicles and assistance for walking.

１ 眼鏡型電子機器
１０ 眼電位検出部
２０ 眼鏡キャリブレーション装置
３０ キャリブレーション部
４０ 眼球動かし部
４１ デイスプレイ
５０ 眼球動き検出部REFERENCE SIGNS LIST 1 eyeglass-type electronic device 10 eye potential detection unit 20 eyeglass calibration device 30 calibration unit 40 eye movement unit 41 display 50 eye movement detection unit

Claims (10)

眼球の動きを検出する眼球動き検出手段と、
眼電位を検出する眼電位検出手段と、
前記眼球動き検出手段の検出結果に応じて検出される前記眼電位検出手段の検出結果を基に、眼電位をキャリブレーションするキャリブレーション手段と
を有する
眼電位キャリブレーション装置。 Eye movement detecting means for detecting eye movement;
Eye potential detection means for detecting the eye potential;
And a calibration unit that calibrates the eye potential based on the detection result of the eye potential detection unit detected according to the detection result of the eye movement detection unit. 請求項１に記載の眼電位キャリブレーション装置であって、
人体の眼球に予め決められた動きを行わせるための眼球動かし手段
を有する
眼電位キャリブレーション装置。 The electro-oculogram calibration device according to claim 1, wherein
An electro-oculogram calibration device comprising eye movement means for causing an eye of a human body to perform a predetermined movement. 前記眼球動かし手段は、眼球を表示するディスプレイ上で眼球を動かすための着目点の表示を行う
請求項２に記載の眼電位キャリブレーション装置。 The eye potential calibration device according to claim 2, wherein the eye movement means displays a focus point for moving the eye on a display for displaying the eye. 前記眼球動かし手段は、眼球を表示するディスプレイ上に、眼球を動かす案内表示を行う
請求項２に記載の眼電位キャリブレーション装置。 The electrooculogram calibration device according to claim 2, wherein the eye movement means performs guidance display for moving the eye on a display for displaying the eye. 前記眼球動かし手段は、眼球に予め決められた角度の動きを行わせ、
前記眼球動き検出手段は、前記眼球動かし手段に応じて眼球が動いた角度を検出する
請求項２に記載の眼電位キャリブレーション装置。 The eye movement means causes the eye to move at a predetermined angle,
The eye potential calibration device according to claim 2, wherein the eye movement detecting means detects an angle at which the eye has moved according to the eye moving means. 前記眼球動き検出手段は、カメラで眼球を撮像して得た画像データを基に眼球の動きを検出する
請求項１に記載の眼電位キャリブレーション装置。 The eye potential calibration device according to claim 1, wherein the eye movement detection unit detects movement of the eye based on image data obtained by imaging the eye with a camera. 請求項１〜請求項６のいずれかに記載の眼電位キャリブレーション装置を備えた眼鏡型電子機器。 The glasses-type electronic device provided with the electro-oculogram calibration apparatus in any one of Claims 1-6. コンピュータが眼電位をキャリブレーションする方法であって、
眼球の動きを検出する眼球動き検出ステップと、
眼電位を検出する眼電位検出ステップと、
前記眼球動き検出ステップの検出結果に応じて検出される前記眼電位検出ステップの検出結果を基に、眼電位をキャリブレーションするキャリブレーションステップと
を有する眼電位キャリブレーション方法。 The computer is a method of calibrating the electrooculogram,
An eye movement detection step of detecting eye movement;
An electro-oculogram detection step of detecting an electro-oculogram;
A calibration step of calibrating the eye potential based on the detection result of the eye potential detection step detected according to the detection result of the eye movement detection step. 人体の眼球に予め決められた動きを行わせるための眼球動かしステップ
を有する請求項８に記載の眼電位キャリブレーション方法。 The eye potential calibration method according to claim 8, further comprising: an eye movement step for causing the eye of the human body to perform a predetermined movement. 請求項８又は請求項９に記載の眼電位キャリブレーション方法をコンピュータに実行させるためのプログラム。 A program for causing a computer to execute the electro-oculogram calibration method according to claim 8 or 9.
JP2017561576A 2016-01-15 2016-12-27 Electro-oculogram calibration device, eyeglass-type electronic device, electro-oculogram calibration method and program Active JP6538203B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2016006319 2016-01-15
JP2016006319 2016-01-15
PCT/JP2016/088861 WO2017122533A1 (en) 2016-01-15 2016-12-27 Ocular potential calibration device, spectacle-type electronic device, ocular potential calibration method, and program

Publications (2)

Publication Number Publication Date
JPWO2017122533A1 JPWO2017122533A1 (en) 2018-09-13
JP6538203B2 true JP6538203B2 (en) 2019-07-03

Family

ID=59311035

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017561576A Active JP6538203B2 (en) 2016-01-15 2016-12-27 Electro-oculogram calibration device, eyeglass-type electronic device, electro-oculogram calibration method and program

Country Status (2)

Country Link
JP (1) JP6538203B2 (en)
WO (1) WO2017122533A1 (en)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014124308A (en) * 2012-12-26 2014-07-07 Panasonic Corp Eye potential generation device, eye potential generation method, and viewer
JP2015202199A (en) * 2014-04-14 2015-11-16 株式会社ジェイアイエヌ Eye potential information processing equipment, eye potential information processing system, attachment tool, and program
JP2015202197A (en) * 2014-04-14 2015-11-16 株式会社ジェイアイエヌ Eye potential information processing equipment, eye potential information processing system, attachment tool, and program

Also Published As

Publication number Publication date
WO2017122533A1 (en) 2017-07-20
JPWO2017122533A1 (en) 2018-09-13

Similar Documents

Publication Publication Date Title
CN110520824B (en) Multimode eye tracking
Cognolato et al. Head-mounted eye gaze tracking devices: An overview of modern devices and recent advances
US20160070122A1 (en) Computerized replacement temple for standard eyewear
JP6426589B2 (en) Electro-oculogram detection device, electro-oculogram detection method, eyewear and frame
US8449116B2 (en) Electro-oculography estimating device, electro-oculography calculating method, eye-gaze tracking device, wearable camera, head-mounted display, and electronic eyeglasses
JP6077720B2 (en) Method for determining at least one value of a parameter for customizing a vision compensation device
ES2932157T3 (en) Determination of a refractive error of an eye
US11029754B2 (en) Calibration method, portable device, and computer-readable storage medium
JP2020525228A (en) Method for locating rotation point of target eye and related apparatus
JP2019162251A (en) Eyeball rotation detection device, electronic equipment, and system
WO2016194581A1 (en) Posture detection device, spectacle-type electronic device, posture detection method, and program
WO2018155098A1 (en) Information processing method, information processing device, and program
JPWO2016194772A1 (en) Wear determination apparatus, glasses-type electronic device, wear determination method, and program
JP4802329B2 (en) Eye position measuring method and eye position measuring apparatus
JP6687639B2 (en) Information processing method, information processing device, program, and eyewear
JP6538203B2 (en) Electro-oculogram calibration device, eyeglass-type electronic device, electro-oculogram calibration method and program
Kasprowski Eye tracking hardware: past to present, and beyond
JP2015123262A (en) Sight line measurement method using corneal surface reflection image, and device for the same
JPH1185384A (en) Visual acuity input method and device using cornea retina potential
JP7170258B2 (en) Electro-oculogram data processing device compatible with wearable device, glasses-type wearable device provided with the same, and electro-oculography data processing method compatible with wearable device
KR102665504B1 (en) Method and system for providing subconscious ophthalmologic examination based on virtual reality contents
JP6557582B2 (en) Human body potential detection apparatus, glasses-type electronic device, human body potential detection method, and program
JP2022059595A (en) Electronic apparatus and display method
CN116068293A (en) Method for detecting eye movements of a spectacle user

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20180404

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20190108

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190305

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20190514

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190605

R150 Certificate of patent or registration of utility model

Ref document number: 6538203

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150