CN104274151B - 视线检测装置和视线检测方法 - Google Patents

视线检测装置和视线检测方法 Download PDF

Info

Publication number
CN104274151B
CN104274151B CN201410299568.8A CN201410299568A CN104274151B CN 104274151 B CN104274151 B CN 104274151B CN 201410299568 A CN201410299568 A CN 201410299568A CN 104274151 B CN104274151 B CN 104274151B
Authority
CN
China
Prior art keywords
user
line
light
eyeball
sight
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410299568.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN104274151A (zh
Inventor
野田卓郎
渡边明香
长谷野慎
长谷野慎一
片方健太
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN104274151A publication Critical patent/CN104274151A/zh
Application granted granted Critical
Publication of CN104274151B publication Critical patent/CN104274151B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14—Arrangements specially adapted for eye photography
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons
    • A61B5/1171—Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/197—Matching; Classification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40—Spoof detection, e.g. liveness detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/635—Region indicators; Field of view indicators
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Pathology (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Eye Examination Apparatus (AREA)
CN201410299568.8A 2013-07-05 2014-06-27 视线检测装置和视线检测方法 Expired - Fee Related CN104274151B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013141990A JP6175945B2 (ja) 2013-07-05 2013-07-05 視線検出装置及び視線検出方法
JP2013-141990 2013-07-05

Publications (2)

Publication Number Publication Date
CN104274151A CN104274151A (zh) 2015-01-14
CN104274151B true CN104274151B (zh) 2017-09-12

Family

ID=52132550

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410299568.8A Expired - Fee Related CN104274151B (zh) 2013-07-05 2014-06-27 视线检测装置和视线检测方法

Country Status (3)

Country Link
US (1) US9092671B2 (enExample)
JP (1) JP6175945B2 (enExample)
CN (1) CN104274151B (enExample)

Families Citing this family (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3063606A4 (en) * 2013-10-30 2017-08-09 Technology Against ALS Communication and control system and method
WO2015086617A1 (en) * 2013-12-09 2015-06-18 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Method for operating an eye tracking device and eye tracking device for providing an active illumination control for improved eye tracking robustness
USD790584S1 (en) * 2013-12-16 2017-06-27 Fujifilm Corporation Electronic viewfinder display screen with graphical user interface
US10198865B2 (en) 2014-07-10 2019-02-05 Seiko Epson Corporation HMD calibration with direct geometric modeling
WO2016110451A1 (en) * 2015-01-07 2016-07-14 The Eye Tribe Aps Dynamic camera or light operation
WO2016136074A1 (ja) * 2015-02-23 2016-09-01 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
CN106796354A (zh) * 2015-04-01 2017-05-31 Fove股份有限公司 头戴式显示器
US10678897B2 (en) 2015-04-16 2020-06-09 Tobii Ab Identification, authentication, and/or guiding of a user using gaze information
KR20170138475A (ko) * 2015-04-16 2017-12-15 토비 에이비 시선 정보를 사용하는 사용자의 식별 및/또는 인증
TWI569040B (zh) * 2015-05-07 2017-02-01 尚立光電股份有限公司 自動調焦頭戴式顯示裝置
US10192133B2 (en) 2015-06-22 2019-01-29 Seiko Epson Corporation Marker, method of detecting position and pose of marker, and computer program
US10192361B2 (en) 2015-07-06 2019-01-29 Seiko Epson Corporation Head-mounted display device and computer program
JP6536324B2 (ja) * 2015-09-30 2019-07-03 富士通株式会社 視線検出システム、視線検出方法および視線検出プログラム
JP6638354B2 (ja) * 2015-12-01 2020-01-29 株式会社Ｊｖｃケンウッド 視線検出装置及び視線検出方法
US10424117B2 (en) 2015-12-02 2019-09-24 Seiko Epson Corporation Controlling a display of a head-mounted display device
JP2017134558A (ja) * 2016-01-27 2017-08-03 ソニー株式会社 情報処理装置、情報処理方法、およびプログラムを記録したコンピュータ読み取り可能な記録媒体
DE102016204148A1 (de) * 2016-03-14 2017-09-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Multiaperturabbildungsvorrichtung, Abbildungssystem und Verfahren zum Erfassen eines Objektbereichs
CN205594581U (zh) 2016-04-06 2016-09-21 北京七鑫易维信息技术有限公司 视频眼镜的眼球追踪模组
JP6665650B2 (ja) * 2016-04-15 2020-03-13 株式会社リコー 電源制御装置、画像形成装置及び出力制御方法
CN110705507B (zh) * 2016-06-30 2022-07-08 北京七鑫易维信息技术有限公司 一种身份识别方法及装置
JP6717377B2 (ja) * 2016-07-04 2020-07-01 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
WO2018078409A1 (en) * 2016-10-28 2018-05-03 Essilor International Method of determining an eye parameter of a user of a display device
CN106845438A (zh) * 2017-02-13 2017-06-13 联想(北京)有限公司 一种人脸识别方法、装置及电子设备
CN106908951A (zh) * 2017-02-27 2017-06-30 阿里巴巴集团控股有限公司 虚拟现实头戴设备
EP3382464A1 (en) * 2017-03-30 2018-10-03 Canon Kabushiki Kaisha Developing device
CN106874895B (zh) * 2017-03-31 2019-02-05 北京七鑫易维信息技术有限公司 一种视线追踪装置及头戴式显示设备
US11068733B2 (en) * 2017-11-28 2021-07-20 Fingerprint Cards Ab Biometric imaging system and method of determining properties of a biometric object using the biometric imaging system
CN108171125A (zh) * 2017-12-13 2018-06-15 广东欧珀移动通信有限公司 虹膜识别组件及具有其的电子设备
US10928900B2 (en) 2018-04-27 2021-02-23 Technology Against Als Communication systems and methods
FR3085516B1 (fr) * 2018-09-05 2021-09-24 Idemia Identity & Security France Procede de reconnaissance biometrique
CN109376595B (zh) * 2018-09-14 2023-06-23 杭州宇泛智能科技有限公司 基于人眼注意力的单目rgb摄像头活体检测方法及系统
KR20210082172A (ko) * 2018-09-21 2021-07-02 마쿠로직스, 아이엔씨. 안과 시험 및 측정을 위한 방법, 장치 및 시스템
CN111124103A (zh) * 2018-10-31 2020-05-08 托比股份公司 检测头戴式装置的重新定位
US10802282B2 (en) 2018-12-21 2020-10-13 Microsoft Technology Licensing, Llc Controlling light source intensities on optically trackable object
US11036043B2 (en) * 2019-01-17 2021-06-15 Advanced New Technologies Co., Ltd. Identity authentication using lens features
CN109965843B (zh) * 2019-03-14 2022-05-24 华南师范大学 一种基于滤波传像的眼动系统
CN109879170B (zh) * 2019-03-29 2020-08-04 哈尔滨理工大学 一种起重机吊臂旁弯位移实时检测系统
JP2020167517A (ja) * 2019-03-29 2020-10-08 ソニー株式会社 画像処理装置と画像処理方法とプログラムおよび撮像装置
JP7374635B2 (ja) 2019-07-12 2023-11-07 キヤノン株式会社 発光装置
JP6969807B2 (ja) * 2019-09-24 2021-11-24 サン・シールド株式会社 作業支援システム
CN114631304B (zh) * 2019-10-31 2024-12-27 佳能株式会社 摄像设备、电子装置、取景器单元
JP7599839B2 (ja) * 2020-04-30 2024-12-16 キヤノン株式会社 電子機器、電子機器の制御方法、プログラム
US11822714B2 (en) * 2020-05-15 2023-11-21 Canon Kabushiki Kaisha Electronic device and control method for capturing an image of an eye
JP7446913B2 (ja) * 2020-05-21 2024-03-11 キヤノン株式会社 電子機器、電子機器の制御方法、プログラム
CN111781722A (zh) * 2020-07-01 2020-10-16 业成科技（成都）有限公司 眼球追踪结构、电子装置及智能眼镜
JP7566517B2 (ja) * 2020-07-15 2024-10-15 キヤノン株式会社 電子機器およびその制御方法
JP7481225B2 (ja) * 2020-10-08 2024-05-10 エルジー ディスプレイ カンパニー リミテッド ヘッドマウントディスプレイ
CN116322475A (zh) * 2020-10-13 2023-06-23 索尼集团公司 视线检测设备、显示设备以及眼球感测方法
US11397465B1 (en) 2021-05-17 2022-07-26 Microsoft Technology Licensing, Llc Glint-based eye tracker illumination using dual-sided and dual-layered architectures
US12019797B2 (en) * 2021-09-01 2024-06-25 Tdk Corporation Gaze tracking for a retinal projection display system
KR102878100B1 (ko) 2022-07-06 2025-10-30 캐논 가부시끼가이샤 발광 장치, 및 그것을 구비하는 표시장치와 전자기기

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1084728A (zh) * 1992-06-02 1994-04-06 佳能株式会社 具有视线检测器的光学装置
US5386258A (en) * 1991-01-17 1995-01-31 Canon Kabushiki Kaisha Optical apparatus having a visual axis direction detecting device
US5485241A (en) * 1992-09-07 1996-01-16 Canon Kabushiki Kaisha Optical equipment with device for detecting direction of visual axis
EP1138256A2 (en) * 2000-03-22 2001-10-04 Nidek Co., Ltd. Fundus camera with visible and invisible illumination
US6424376B1 (en) * 1993-07-30 2002-07-23 Canon Kabushiki Kaisha Selection apparatus using an observer's line of sight
CN1817295A (zh) * 2005-01-24 2006-08-16 株式会社拓普康 视力表装置及眼睛检测装置
CN101282680A (zh) * 2005-10-10 2008-10-08 托比技术有限公司 具有延长范围的操作距离的眼跟踪器
CN102046067A (zh) * 2008-03-27 2011-05-04 多汉尼眼科研究所 光学相干断层分析设备、方法及系统

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05333259A (ja) 1992-06-02 1993-12-17 Canon Inc 視線検出手段を有した光学装置
JPH07128579A (ja) * 1993-10-29 1995-05-19 Canon Inc 視線検知方法、視線検知手段及び該視線検知手段を有する映像機器
JP3450449B2 (ja) * 1994-07-18 2003-09-22 キヤノン株式会社 撮像装置およびその撮像方法
US5583795A (en) * 1995-03-17 1996-12-10 The United States Of America As Represented By The Secretary Of The Army Apparatus for measuring eye gaze and fixation duration, and method therefor
JPH1020183A (ja) * 1996-07-05 1998-01-23 Canon Inc 視線検出機能を有する撮像装置及び電子機器
JPH10179521A (ja) * 1996-12-26 1998-07-07 Canon Inc 視線／接眼検出方法及び装置並びに記憶媒体
DE69810557D1 (de) * 1997-08-27 2003-02-13 Canon Kk Gerät und Verfahren zum Eingeben von Daten basierend auf visueller Erfassung
JP2002101322A (ja) * 2000-07-10 2002-04-05 Matsushita Electric Ind Co Ltd 虹彩カメラモジュール
JP2003000544A (ja) * 2001-06-20 2003-01-07 Canon Inc 視線検出装置
US7167201B2 (en) * 2003-04-28 2007-01-23 Hewlett-Packard Development Company, L.P. Device incorporating eye-start capability
WO2007113975A1 (ja) * 2006-03-31 2007-10-11 National University Corporation Shizuoka University 視点検出装置
FR2943797B1 (fr) * 2009-03-27 2011-03-18 Thales Sa Systeme d'imagerie a afficheur actif et muni d'une bonnette
JP5316387B2 (ja) * 2009-12-04 2013-10-16 ソニー株式会社 情報処理装置、表示方法及びプログラム

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5386258A (en) * 1991-01-17 1995-01-31 Canon Kabushiki Kaisha Optical apparatus having a visual axis direction detecting device
CN1084728A (zh) * 1992-06-02 1994-04-06 佳能株式会社 具有视线检测器的光学装置
US5485241A (en) * 1992-09-07 1996-01-16 Canon Kabushiki Kaisha Optical equipment with device for detecting direction of visual axis
US6424376B1 (en) * 1993-07-30 2002-07-23 Canon Kabushiki Kaisha Selection apparatus using an observer's line of sight
EP1138256A2 (en) * 2000-03-22 2001-10-04 Nidek Co., Ltd. Fundus camera with visible and invisible illumination
CN1817295A (zh) * 2005-01-24 2006-08-16 株式会社拓普康 视力表装置及眼睛检测装置
CN101282680A (zh) * 2005-10-10 2008-10-08 托比技术有限公司 具有延长范围的操作距离的眼跟踪器
CN102046067A (zh) * 2008-03-27 2011-05-04 多汉尼眼科研究所 光学相干断层分析设备、方法及系统

Also Published As

Publication number Publication date
CN104274151A (zh) 2015-01-14
US20150009313A1 (en) 2015-01-08
JP2015013031A (ja) 2015-01-22
US9092671B2 (en) 2015-07-28
JP6175945B2 (ja) 2017-08-09

Similar Documents

Publication Publication Date Title
CN104274151B (zh) 视线检测装置和视线检测方法
US10061384B2 (en) Information processing apparatus, information processing method, and program
US11099641B2 (en) Calibration, customization, and improved user experience for bionic lenses
WO2015012280A1 (ja) 視線検出装置
CN104903818A (zh) 眼睛跟踪佩戴式设备和使用方法
JP2003225207A (ja) 視線検出装置
US10452911B2 (en) Gaze-tracking system using curved photo-sensitive chip
JP3925222B2 (ja) 視線検出装置
CN112306229A (zh) 电子装置、控制方法和计算机可读介质
US20250365486A1 (en) Display apparatus, finder apparatus, and imaging apparatus
US20250216941A1 (en) Line-of-sight detection device and head mounted display device
US20250208707A1 (en) Line-of-sight detection device and head mounted display device
WO2021210235A1 (ja) 電子機器
US20230092593A1 (en) Detection device detecting gaze point of user, control method therefor, and storage medium storing control program therefor
JP2024092950A (ja) 視線検出装置
WO2015193953A1 (ja) 画像表示装置及び光学デバイス
JP2021182736A (ja) 電子機器
US12339457B2 (en) Line-of-sight detection device and head mounted display device
JP7446898B2 (ja) 電子機器
JP2021076832A (ja) 撮像装置、電子機器、ファインダーユニット
WO2021085541A1 (ja) 撮像装置、電子機器、ファインダーユニット

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170912

CF01 Termination of patent right due to non-payment of annual fee