WO2016184107A1 - Appareil pouvant être porté permettant une localisation de foyer de ligne visuelle, et procédé de localisation de foyer de ligne visuelle - Google Patents

Appareil pouvant être porté permettant une localisation de foyer de ligne visuelle, et procédé de localisation de foyer de ligne visuelle Download PDF

Info

Publication number
WO2016184107A1
WO2016184107A1 PCT/CN2015/098877 CN2015098877W WO2016184107A1 WO 2016184107 A1 WO2016184107 A1 WO 2016184107A1 CN 2015098877 W CN2015098877 W CN 2015098877W WO 2016184107 A1 WO2016184107 A1 WO 2016184107A1
Authority
WO
WIPO (PCT)
Prior art keywords
infrared light
right eye
iris
sight
line
Prior art date
Application number
PCT/CN2015/098877
Other languages
English (en)
Chinese (zh)
Inventor
宋展
聂颖
Original Assignee
中国科学院深圳先进技术研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国科学院深圳先进技术研究院 filed Critical 中国科学院深圳先进技术研究院
Publication of WO2016184107A1 publication Critical patent/WO2016184107A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to the field of line-of-sight tracking technology, and more particularly to a wearable device and a line-of-sight focus positioning method for line-of-sight focus positioning.
  • the existing gaze tracking technology often collects facial and facial images through a camera, and optically calculates and tracks the direction of the line of sight.
  • gaze tracking devices can be divided into wearable and non-wearable.
  • the wearable device collects the eye image through the camera, first determines the direction of the line of sight in the camera coordinate system; and then determines the direction of the line of sight in the world coordinate system by adding peripherals and the like.
  • the eye is captured by a plurality of external cameras and the eye image is acquired, and the spatial coordinates of the tester's line of sight are directly obtained.
  • the biggest disadvantage of non-wearable devices is that they need to accurately illuminate the eyes with infrared point light sources, so they can't move the head position casually.
  • the camera has high precision requirements, and it is also highly susceptible to environmental factors and is difficult to promote.
  • the line-of-sight tracking technology can be divided into 2D line-of-sight tracking technology and 3D line-of-sight tracking technology.
  • the 2D tracking technique is represented by the pupil-corneal reflex method, which uses a vector composed of the pupil center and the corneal bright spot to characterize the line of sight.
  • There are many similar devices in the 2D tracking technology For example, there is an operating pointer indicating control device based on human eye image and gaze tracking in the prior art, which can be worn on the human head and can operate the operating pointer through the eye movement.
  • the human-computer interaction is realized by the operation control, and in the process of the interactive control, the human-computer interaction effect of the indicated position of the operation pointer and the real scene observed by the human eye line is achieved.
  • the device adopts an infrared ranging sensor to measure the position of the human eye, and also emits infrared light in real time to the position of the human eye through its infrared emitter, thereby serving as an auxiliary infrared light source, and using infrared light in the human eye.
  • Reflecting on the cornea to form a corneal reflection spot correspondingly using a miniature infrared camera to effectively capture the original infrared image of the position of the human eye for human eye recognition and line-of-sight tracking, avoiding interference caused by dark conditions such as visible light, and cornea Reflective spots can be used later
  • the position of the center of the corneal reflection spot is positioned, and then the position of the center of the pupil is combined to assist in capturing the line of sight of the human eye.
  • the device also divides the image of the human eye region, and the image region of the segmented human eye region image is relatively fixed regardless of whether the position of the human eye in the original image changes displacement due to head motion.
  • the 3D tracking technology uses the dual camera or multi-camera to obtain the coordinates of each reference point in the 3D space for line-of-sight tracking. Compared with the 2D tracking technology, the accuracy and stability are improved.
  • the main problem is that the available 3D features are relatively small, and only the approximate 3D motion information of the eyeball can be obtained through several feature points, and high-precision line-of-sight positioning cannot be achieved.
  • Embodiments of the present invention provide a wearable device for line-of-sight focus positioning, which is used to achieve high-precision line-of-sight focus positioning and ignore the influence of head motion.
  • the device includes:
  • a plurality of infrared light sources respectively mounted on the left and right eyeglass frames of the eyeglass holder; the plurality of infrared light sources are distributed at different positions on the left and right eyeglass frames for illuminating the iris from different angles;
  • a camera for capturing an iris image illuminated by an infrared light source is also mounted on the frame;
  • a signal processing unit is further mounted on the eyeglass holder, and the signal processing unit includes:
  • a synchronization control module configured to control the plurality of infrared light sources to be respectively turned on in a set order; and, when the infrared light source is turned on, the camera on the frame of the infrared light source that is synchronously triggered to turn on the iris image illuminated by the infrared light source;
  • the image processing module is configured to process the iris image to establish a 3D model of the left and right eye irises; and to locate the left and right eye line of sight according to the 3D model of the left and right eye irises.
  • the synchronization control module is specifically configured to control each of the left and right eyeglass frames to have an infrared light source turned on at the same time, and control the camera on the left and right eyeglass frames to simultaneously capture an iris image illuminated by the turned infrared light source.
  • the image processing module is specifically configured to simultaneously process an iris image captured by a camera on the left and right eyeglass frames.
  • the image processing module is specifically configured to:
  • the iris images illuminated by the different infrared light sources from different angles are processed to establish a 3D model of the left and right eye irises;
  • the normal directions of the 3D planes of the left and right eye irises are respectively determined as the line of sight directions of the left and right eyes;
  • the focus position of the left and right eyesight lines in the world coordinate system is determined.
  • the camera is equipped with an infrared filter.
  • the signal processing unit further includes:
  • a communication module configured to send the positioned left and right eye sight position to the controlled device
  • the embodiment of the invention further provides a line-of-sight focus positioning method for realizing high-precision line-of-sight focus positioning, the method comprising:
  • the left and right eyesight focus is positioned.
  • the left and right eyes are each illuminated by an infrared light source, and an iris image of the left and right eyes illuminated by the infrared light source is obtained;
  • the obtained iris images of the left and right eyes illuminated by the infrared light source are processed.
  • the obtained iris image is processed to create a 3D model of the left and right eye irises, including:
  • the iris images of the left and right eyes are processed by different infrared light sources from different angles to establish a 3D model of the left and right eye irises;
  • the left and right eyesight focus is located, including:
  • the normal directions of the 3D planes of the left and right eye irises are respectively determined as the line of sight directions of the left and right eyes;
  • the focus position of the left and right eyesight lines in the world coordinate system is determined.
  • determining the focus position of the left and right eye lines of sight in the world coordinate system according to the left and right eye line of sight directions including:
  • the focus position of the left and right eyesight lines in the world coordinate system is determined.
  • the method further includes:
  • the positioned left and right eye line focus positions are sent to the controlled device.
  • the wearable device and the line-of-sight focus positioning method for line-of-sight focus positioning use a plurality of infrared light sources to respectively illuminate the left and right eyes from different angles, and obtain a plurality of infrared light sources respectively illuminating the iris images of the left and right eyes from different angles;
  • the obtained iris image is processed to establish a 3D model of the left and right eye irises; according to the 3D model of the left and right eye irises, the left and right eye line of sight is positioned; since the 3D model of the left and right eye irises is based on the iris image is composed of multiple infrared light sources respectively
  • the different angles are obtained by illuminating the left and right eyes.
  • the wearable device for line-of-sight focus positioning of the embodiment of the present invention is also designed in the shape of glasses to achieve a wearable operation, and the influence of head movement can be ignored.
  • FIG. 1 is a schematic diagram of a wearable device for line-of-sight focus positioning according to an embodiment of the present invention
  • FIG. 2 is a detailed working principle diagram of a wearable device for line-of-sight focus positioning according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a line-of-sight focus positioning method according to an embodiment of the present invention.
  • an embodiment of the present invention provides a wearable device and a line-of-sight focus positioning method for line-of-sight focus positioning, which utilizes a three-dimensional reconstruction technique to reconstruct a three-dimensional shape of an iris in an eyeball, and analyzes the three-dimensional model.
  • the line of sight of the two eyeballs is obtained, thereby obtaining the intersection of the binocular line of sight direction, thereby achieving the purpose of tracking the line of sight focus; in the case of obtaining the iris image in the eyeball in real time and performing analysis processing, the embodiment of the present invention can track the line of sight focus in real time. .
  • FIG. 1 is a schematic diagram of a wearable device for line-of-sight focus positioning according to an embodiment of the present invention. As shown in FIG. 1, the device may include:
  • a plurality of infrared light sources 2 are respectively mounted on the left and right eyeglass frames of the eyeglass holder 1; the plurality of infrared light sources 2 are distributed at different positions on the left and right eyeglass frames for illuminating the iris from different angles;
  • the left and right eyeglass frames are respectively mounted with a camera 3 for capturing an iris image illuminated by the infrared light source 2;
  • a signal processing unit 4 is further mounted on the eyeglass holder 1 , and the signal processing unit 4 includes:
  • a synchronization control module configured to control the plurality of infrared light sources 2 to be respectively turned on in a set order; and, while the infrared light source 2 is turned on, the camera 3 on the frame of the infrared light source 2 that is synchronously triggered to turn on is photographed by the infrared light source 2 Underlying iris image;
  • the image processing module is configured to process the iris image to establish a 3D model of the left and right eye irises; and to locate the left and right eye line of sight according to the 3D model of the left and right eye irises.
  • the wearable device for gazing focus positioning uses a plurality of infrared light sources to respectively illuminate the left and right eyes from different angles, and obtains a plurality of infrared light sources respectively illuminating the iris images of the left and right eyes from different angles; and processing the obtained iris images, A 3D model of the left and right eye irises is established; the left and right eye line of sight is positioned according to the 3D model of the left and right eye irises; the iris image based on the 3D model for establishing the left and right eye irises is obtained by illuminating the left and right eyes from different angles by a plurality of infrared light sources, respectively.
  • the device has a simple structure and low cost, and the infrared light source is safe to the human eye and does not affect the normal work of the person; the use in the form of glasses is naturally fixed with the head position, and is not affected by the head movement.
  • the dynamic 3D reconstruction of the iris can be realized based on the 3D optical principle, and the high-precision 3D shape of the iris can be obtained, thereby obtaining the line of sight information.
  • the left and right eye cameras can work at the same time to obtain the line of sight information of the left and right eyes, and then combine the calibration information of the two cameras to obtain the position of the line of sight focus; thus, the working speed is fast, real-time 3D reconstruction and line-of-sight focus positioning can be realized.
  • the synchronous control module can be specifically used to control the left and right glasses frames to have one infrared light source turned on at the same time, and control the iris image under the illumination of the open infrared light source while controlling the camera on the left and right eyeglass frames; the image processing module can be specifically used The iris image taken by the camera on the left and right eyeglass frames is simultaneously processed.
  • the image processing module may be specifically configured to: combine the iris direction image corresponding to the calibration direction parameter of the infrared light source, and based on the photometric 3D reconstruction principle, process the iris image illuminated by different infrared light sources from different angles to establish the left and right eye irises. 3D model; planar fitting of the 3D model of the left and right eye iris to obtain the 3D plane of the left and right eye iris; determining the normal direction of the 3D plane of the left and right eye iris as the line of sight of the left and right eyes respectively; combining the left and right glasses according to the direction of the left and right eyesight
  • the calibration parameters of the camera on the frame determine the focus position of the left and right eyesight lines in the world coordinate system.
  • the iris can be sequentially illuminated from different angles by using multiple infrared light sources.
  • the camera performs synchronous shooting, and based on the calibration information such as the direction of the light source, the photometric 3D reconstruction method can be used.
  • the high-precision 3D shape information of the iris, and then the direction information of the line of sight is analyzed, and the above-mentioned processing is performed on the left and right eyes simultaneously, and the spatial relative position information of the left and right cameras is obtained according to the calibration parameters of the left and right cameras, and the line of sight directions of the two eyes can be calculated.
  • the wearable device is designed into the shape of the glasses, so that the wearable operation can be realized, so that the influence of the movement of the head can be ignored.
  • the signal processing unit may further comprise a communication module for transmitting the positioned left and right eye line of sight focus positions to the controlled device.
  • the wearable device for line-of-sight focus positioning can implement a computer, a mobile phone, a tablet, etc. by using a built-in communication module, such as the wireless transmission unit, and transmitting the line-of-sight positioning information to the intelligent terminal.
  • the eye control operation function of the intelligent terminal may also include a power source for powering.
  • the wearable device for line-of-sight focus positioning of the embodiment of the present invention mainly comprises a special eyeglass bracket, a plurality of infrared light sources, such as an infrared LED module (eight in FIG. 1 ), and two cameras ( It can be equipped with an infrared filter), as well as a signal processing unit (which can include a synchronous control module, an image processing module, and a communication module and power supply).
  • a signal processing unit which can include a synchronous control module, an image processing module, and a communication module and power supply.
  • the system calibration part includes two parts, 1) the direction information of each LED light source (relative to the left/right camera coordinate system); 2) the calibration of the stereo vision system composed of the left and right cameras, mainly acquiring two The spatial positional relationship of the camera coordinate system;
  • 3D reconstruction part taking the left eye as an example, the main steps include:
  • the obtained 3D reconstruction model is also approximated to a plane, and the plane normal direction is the direction of the line of sight;
  • the focus position is sent to the operation terminal to realize the interactive operation.
  • Glasses bracket used to install camera, infrared LED light source, and signal processing unit and other hardware equipment;
  • Infrared LED light source In this example, at least four infrared LED light sources are respectively installed on the left and right eyeglass frames for illuminating the eyeball and the iris from different angles, and the infrared rays can penetrate the outer structure of the eyeball such as the cornea to obtain a clearer iris image.
  • the LED power is safe for the human eye, and the band can be selected from commonly used bands such as 850 nm and 940 nm;
  • camera left and right glasses frame respectively installed a camera, equipped with a filter corresponding to the LED band, used to isolate the interference of ambient light, to obtain a clear iris image;
  • Signal processing unit including the following main modules:
  • Synchronous control module used to control the switch of each LED, while the LED is illuminated, synchronously triggering the camera to take a photo
  • an image processing module for processing the acquired iris image, acquiring a 3D model of the iris through a 3D reconstruction algorithm, and performing calculation of a line of sight focus;
  • a communication module configured to transmit the calculated line-of-sight focus position information to the operated terminal.
  • FIG. 1 The detailed working principle of the wearable device for line-of-sight focus positioning according to the embodiment of the present invention is illustrated in FIG. 1 , as shown in FIG. 2 .
  • System parameter calibration including:
  • Synchronous control module controls the synchronous shooting of the camera and four LED lights. If the camera frequency is 60FPS, it can complete 15 cycles per second, and then get 15 times of 3D reconstruction model of iris to realize iris dynamics. 3D reconstruction process;
  • the photometric 3D reconstruction method can be used to obtain the iris 3D by combining the different light source direction information of each LED. model
  • the image processing module uses a high-speed computing module such as DSP or FPGA for real-time image processing and 3D reconstruction;
  • the plane fitting strategy is used to obtain the 3D plane of the iris (relative to the coordinate system of the camera), and the normal direction of the plane indicates the orientation of the pupil: Iris_L1, Iris_L2;
  • the 3D spatial plane position of the iris also changes, the line of sight direction and the line of sight focus also change, and the line of sight direction and focus information are transmitted to the controlled device in real time through the built-in communication module, thereby realizing dynamic Sight focus tracking and interworking functions.
  • the embodiment of the present invention adopts the principle of photometric 3D reconstruction, and forms a dynamic three-dimensional reconstruction system by using several infrared LED lights and a camera in the form of wearable glasses, thereby realizing dynamic 3D reconstruction of the iris, and further Get the normal direction of the plane where the pupil is located, that is, the direction of the line of sight.
  • the two cameras By calibrating the two cameras, the unified coordinate system of the two line-of-sight directions of the left and right eyes is realized, and the dynamic calculation of the line-of-sight focus is completed.
  • the LED light source can be selected by 4 or more, and the number of more light sources can improve the accuracy of the three-dimensional reconstruction; the position of the LED light source and the camera can be adjusted.
  • an embodiment of the present invention further provides a line-of-sight focus positioning method, as described in the following embodiments. Since the method for solving the problem is similar to the wearable device for line-of-sight focus positioning, the implementation of the method can be referred to the implementation of the wearable device for line-of-sight focus positioning, and the repeated description is not repeated.
  • FIG. 3 is a schematic diagram of a line-of-sight focus positioning method according to an embodiment of the present invention.
  • the line-of-sight focus positioning method in the embodiment of the present invention may include:
  • Step 301 Obtain a plurality of infrared light sources respectively illuminating the iris images of the left and right eyes from different angles;
  • Step 302 Processing the obtained iris image to establish a 3D model of the left and right eye irises
  • Step 303 Position the left and right eyesight focus according to the 3D model of the left and right eye irises.
  • the left and right eyes can be illuminated by one infrared light source at the same time, and the iris images of the left and right eyes illuminated by the infrared light source are obtained; and the iris images obtained by the infrared light source are simultaneously processed.
  • the obtained iris image is processed to establish a 3D model of the left and right eye iris, which may include:
  • the iris images of the left and right eyes are processed by different infrared light sources from different angles to establish a 3D model of the left and right eye irises;
  • the left and right eyesight focus is located, including:
  • the normal directions of the 3D planes of the left and right eye irises are respectively determined as the line of sight directions of the left and right eyes;
  • the focus position of the left and right eyesight lines in the world coordinate system is determined.
  • determining the focus position of the left and right eyesight lines in the world coordinate system according to the left and right eyesight directions may include:
  • the focus position of the left and right eyesight lines in the world coordinate system is determined.
  • the line-of-sight focus positioning method in the embodiment of the present invention may further include:
  • the positioned left and right eye line focus positions are sent to the controlled device.
  • the wearable device and the line-of-sight focus positioning method for line-of-sight focus positioning use a plurality of infrared light sources to respectively illuminate the left and right eyes from different angles, and obtain a plurality of infrared light sources respectively illuminating the left and right eyes from different angles.
  • the infrared light sources are respectively obtained by illuminating the left and right eyes from different angles.
  • the wearable device for line-of-sight focus positioning of the embodiment of the present invention is also designed in the shape of glasses to achieve a wearable operation, and the influence of head movement can be ignored.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Abstract

L'invention concerne un appareil pouvant être porté permettant une localisation de foyer de ligne visuelle et un procédé de localisation de foyer de ligne visuelle. L'appareil comprend : un socle à lunettes (1), des montures de lunettes gauche et droite du socle à lunettes (1) étant respectivement équipées d'une pluralité de sources de lumière infrarouge (2), la pluralité de sources de lumière infrarouge (2) étant réparties au niveau de différentes positions sur les montures de lunettes gauche et droite pour éclairer des iris sous différents angles, et les montures de lunettes gauche et droite étant en outre respectivement équipées d'une caméra (3) utilisée pour prendre une image de l'iris éclairé par les sources de lumière infrarouge ; le socle à lunettes (1) étant en outre équipé d'une unité de traitement de signal (4), l'unité de traitement de signal (4) comprenant : un module de commande de synchronisation utilisé pour commander la mise sous tension de la pluralité de sources de lumière infrarouge respectivement selon un ordre établi, et pendant que les sources de lumière infrarouge sont sous tension, déclencher d'une manière synchrone les caméras (3) présentes sur les montures de lunettes là où les sources de lumière infrarouge sont mises sous tension pour prendre une image de l'iris éclairé par les sources de lumière infrarouge, et un module de traitement d'image utilisé pour traiter l'image de l'iris afin d'établir un modèle 3D des iris de l'œil gauche et de l'œil droit ; et un foyer de ligne visuelle d'œil gauche et d'œil droit est localisé conformément au modèle 3D des iris de l'œil gauche et de l'œil droit. Une localisation de foyer de ligne visuelle de haute précision peut être réalisée.
PCT/CN2015/098877 2015-05-15 2015-12-25 Appareil pouvant être porté permettant une localisation de foyer de ligne visuelle, et procédé de localisation de foyer de ligne visuelle WO2016184107A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510250492.4A CN104834381B (zh) 2015-05-15 2015-05-15 用于视线焦点定位的可穿戴设备及视线焦点定位方法
CN2015102504924 2015-05-15

Publications (1)

Publication Number Publication Date
WO2016184107A1 true WO2016184107A1 (fr) 2016-11-24

Family

ID=53812318

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/098877 WO2016184107A1 (fr) 2015-05-15 2015-12-25 Appareil pouvant être porté permettant une localisation de foyer de ligne visuelle, et procédé de localisation de foyer de ligne visuelle

Country Status (2)

Country Link
CN (1) CN104834381B (fr)
WO (1) WO2016184107A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110347260A (zh) * 2019-07-11 2019-10-18 歌尔科技有限公司 一种增强现实装置及其控制方法、计算机可读存储介质
CN110826248A (zh) * 2019-11-18 2020-02-21 杭州涂鸦信息技术有限公司 基于光源数据库仿真红外摄像头暗角的方法及系统
CN112578557A (zh) * 2019-09-30 2021-03-30 三星显示有限公司 电子设备

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104834381B (zh) * 2015-05-15 2017-01-04 中国科学院深圳先进技术研究院 用于视线焦点定位的可穿戴设备及视线焦点定位方法
CN105128862A (zh) * 2015-08-18 2015-12-09 上海擎感智能科技有限公司 一种车载终端眼球识别控制方法及系统
CN105141938B (zh) * 2015-08-18 2017-12-01 深圳先进技术研究院 视线定位装置
CN105892634A (zh) * 2015-11-18 2016-08-24 乐视致新电子科技（天津）有限公司 防眩晕方法及虚拟现实显示输出设备
WO2017090203A1 (fr) * 2015-11-27 2017-06-01 フォーブ インコーポレーテッド Système de détection de ligne de visée, et procédé d'identification de point de regard, et programme d'identification de point de regard
CN105487787A (zh) * 2015-12-09 2016-04-13 东莞酷派软件技术有限公司 基于虹膜识别的终端操作方法及装置和终端
US10114465B2 (en) * 2016-01-15 2018-10-30 Google Llc Virtual reality head-mounted devices having reduced numbers of cameras, and methods of operating the same
CN105931272B (zh) * 2016-05-06 2019-04-05 上海乐相科技有限公司 一种运动对象追踪方法及系统
CN106168855B (zh) * 2016-07-01 2020-06-30 北京麦哲科技有限公司 一种便携式mr眼镜、手机和mr眼镜系统
CN106200965B (zh) * 2016-07-08 2017-11-17 广东欧珀移动通信有限公司 一种屏幕显示方法、装置及移动终端
CN106162144A (zh) * 2016-07-21 2016-11-23 触景无限科技（北京）有限公司 一种用于夜视环境的视觉图像处理设备、系统和智能机器
CN110059585B (zh) * 2016-08-18 2023-10-24 瑞声光学解决方案私人有限公司 具虹膜采集功能的虚拟现实设备
CN106339085B (zh) 2016-08-22 2020-04-21 华为技术有限公司 具有视线追踪功能的终端、确定使用者视点的方法及装置
CN106203410B (zh) * 2016-09-21 2023-10-17 上海星寰投资有限公司 一种身份验证方法及系统
SG11201907370XA (en) * 2017-02-12 2019-09-27 Lemnis Tech Pte Ltd Methods, devices and systems for focus adjustment of displays
CN109429060B (zh) * 2017-07-07 2020-07-28 京东方科技集团股份有限公司 瞳孔距离测量方法、可穿戴眼部设备及存储介质
CN107644443B (zh) * 2017-09-01 2020-07-28 北京七鑫易维信息技术有限公司 视线追踪设备中参数设定方法和装置
CN108334191B (zh) * 2017-12-29 2021-03-23 北京七鑫易维信息技术有限公司 基于眼动分析设备的确定注视点的方法和装置
CN108470152A (zh) * 2018-02-14 2018-08-31 天目爱视（北京）科技有限公司 基于红外的3d四维虹膜数据采集方法及系统
CN108681403A (zh) * 2018-05-18 2018-10-19 吉林大学 一种采用视线跟踪的小车控制方法
CN109044263A (zh) * 2018-07-13 2018-12-21 北京七鑫易维信息技术有限公司 眼睛视线的检测方法、装置、设备及存储介质
JP6894880B2 (ja) * 2018-11-07 2021-06-30 矢崎総業株式会社 監視システム
CN110674682B (zh) * 2019-08-15 2021-12-14 武汉虹识技术有限公司 一种双目虹膜图像采集装置及方法
CN113760083A (zh) * 2020-06-01 2021-12-07 张也弛 操作者目光在终端设备屏幕上落点位置的确定方法及装置
CN111983803A (zh) * 2020-08-19 2020-11-24 业成科技（成都）有限公司 眼球追踪模组及电子设备
CN112541975B (zh) * 2020-12-24 2024-03-12 华南理工大学 基于三维头部的头戴产品视野计算方法
CN112926523B (zh) 2021-03-30 2022-07-26 青岛小鸟看看科技有限公司 基于虚拟现实的眼球追踪方法、系统
CN113138664A (zh) * 2021-03-30 2021-07-20 青岛小鸟看看科技有限公司 基于光场感知的眼球追踪系统、方法
CN114136209B (zh) * 2021-11-24 2023-11-24 京东方科技集团股份有限公司 一种眼球位置定位电路、方法、基板及虚拟现实穿戴设备
CN115245630A (zh) * 2022-07-15 2022-10-28 北京鹰瞳科技发展股份有限公司 一种用于近视理疗的红光照射装置以及红光照射方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120019645A1 (en) * 2010-07-23 2012-01-26 Maltz Gregory A Unitized, Vision-Controlled, Wireless Eyeglasses Transceiver
US20130285901A1 (en) * 2012-04-27 2013-10-31 Dongguk University Industry-Academic Cooperation Foundation System and method for tracking gaze at distance
CN103777351A (zh) * 2012-10-26 2014-05-07 鸿富锦精密工业（深圳）有限公司 多媒体眼镜
US20150035745A1 (en) * 2013-07-30 2015-02-05 National Chiao Tung University Head-mount eye tracking system
CN104834381A (zh) * 2015-05-15 2015-08-12 中国科学院深圳先进技术研究院 用于视线焦点定位的可穿戴设备及视线焦点定位方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102830793B (zh) * 2011-06-16 2017-04-05 北京三星通信技术研究有限公司 视线跟踪方法和设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120019645A1 (en) * 2010-07-23 2012-01-26 Maltz Gregory A Unitized, Vision-Controlled, Wireless Eyeglasses Transceiver
US20130285901A1 (en) * 2012-04-27 2013-10-31 Dongguk University Industry-Academic Cooperation Foundation System and method for tracking gaze at distance
CN103777351A (zh) * 2012-10-26 2014-05-07 鸿富锦精密工业（深圳）有限公司 多媒体眼镜
US20150035745A1 (en) * 2013-07-30 2015-02-05 National Chiao Tung University Head-mount eye tracking system
CN104834381A (zh) * 2015-05-15 2015-08-12 中国科学院深圳先进技术研究院 用于视线焦点定位的可穿戴设备及视线焦点定位方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110347260A (zh) * 2019-07-11 2019-10-18 歌尔科技有限公司 一种增强现实装置及其控制方法、计算机可读存储介质
CN112578557A (zh) * 2019-09-30 2021-03-30 三星显示有限公司 电子设备
CN110826248A (zh) * 2019-11-18 2020-02-21 杭州涂鸦信息技术有限公司 基于光源数据库仿真红外摄像头暗角的方法及系统
CN110826248B (zh) * 2019-11-18 2023-10-20 杭州涂鸦信息技术有限公司 基于光源数据库仿真红外摄像头暗角的方法及系统

Also Published As

Publication number Publication date
CN104834381A (zh) 2015-08-12
CN104834381B (zh) 2017-01-04

Similar Documents

Publication Publication Date Title
WO2016184107A1 (fr) Appareil pouvant être porté permettant une localisation de foyer de ligne visuelle, et procédé de localisation de foyer de ligne visuelle
KR102658303B1 (ko) 인사이드-아웃 위치, 사용자 신체 및 환경 추적을 갖는 가상 및 혼합 현실을 위한 머리 장착 디스플레이
CN104090659B (zh) 基于人眼图像和视线追踪的操作指针指示控制设备
US9710973B2 (en) Low-latency fusing of virtual and real content
KR102456047B1 (ko) 아이웨어 장착 가능 안구 추적 디바이스
US9916005B2 (en) Gaze tracking with projector
CN105574525B (zh) 一种复杂场景多模态生物特征图像获取方法及其装置
EP3371781B1 (fr) Systèmes et procédés de génération et d'utilisation d'images tridimensionnelles
CN103293673B (zh) 集成显示器和眼动仪和虹膜识别仪的帽子
EP3251092A1 (fr) Génération automatique de matériaux virtuels à partir de matériaux du monde réel
WO2015105689A1 (fr) Mise en correspondance de reflets avec des sources de lumière
JPH0782539B2 (ja) 瞳孔画像撮影装置
US11712619B2 (en) Handle controller
WO2018154272A1 (fr) Systèmes et procédés pour obtenir des informations concernant le visage et les yeux d'un sujet
EP3542308B1 (fr) Procédé et dispositif d'acquisition de mesure d' il
CN111524175A (zh) 非对称式多摄像头的深度重建及眼动追踪方法及系统
WO2016101861A1 (fr) Visiocasque
RU2007117996A (ru) Способ измерения быстрых движений глаз и отклонений бинокулярного зрения и устройство для его реализации
US20230104656A1 (en) Gaze tracking
Hornak et al. Point-of-Gaze Estimation on Embedded Platform
JP2022113973A (ja) 表示方法、表示装置、及び、プログラム
Combier et al. Towards an Augmented Reality Head Mounted Display System Providing Stereoscopic Wide Field of View for Indoor and Outdoor Environments with Interaction through the Gaze Direction
Garcia et al. A distributed real time eye-gaze tracking system
CN114578940A (zh) 一种控制方法、装置和电子设备
CN112965607A (zh) 一种眼镜鼠标及其控制方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15892481

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 04.05.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 15892481

Country of ref document: EP

Kind code of ref document: A1