WO2023159526A1 - 一种眼球追踪系统及其使用方法 - Google Patents

一种眼球追踪系统及其使用方法 Download PDF

Info

Publication number
WO2023159526A1
WO2023159526A1 PCT/CN2022/078113 CN2022078113W WO2023159526A1 WO 2023159526 A1 WO2023159526 A1 WO 2023159526A1 CN 2022078113 W CN2022078113 W CN 2022078113W WO 2023159526 A1 WO2023159526 A1 WO 2023159526A1
Authority
WO
WIPO (PCT)
Prior art keywords
eye
tracking system
mark
user
eyeball
Prior art date
Application number
PCT/CN2022/078113
Other languages
English (en)
French (fr)
Inventor
曹庆恒
Original Assignee
曹庆恒
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 曹庆恒 filed Critical 曹庆恒
Priority to PCT/CN2022/078113 priority Critical patent/WO2023159526A1/zh
Priority to CN202280000283.2A priority patent/CN114787755A/zh
Publication of WO2023159526A1 publication Critical patent/WO2023159526A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements

Definitions

  • the present invention relates to the technical field of information communication, in particular to an eye tracking system and its usage method.
  • the eye tracking technology is mainly reflected in three aspects: one is to track according to the characteristic changes of the eyeball and the surrounding of the eyeball; the other is to track according to the change of the iris angle; the third is to actively project infrared light beams to the iris to extract features.
  • the eye tracking technology which actively projects infrared beams to the iris to extract features, has relatively good accuracy and has been widely used in the field of human-computer interaction based on eye tracking.
  • the image quality and recognition processing capabilities are high. If the eye tracking system or the eyeball is in a bumpy environment, it will cause image acquisition.
  • the module captures defects such as smear in the eyeball image, which affects the recognition of the features of the eyeball or iris, resulting in low eye tracking accuracy.
  • the user can wear eye markers to help eye tracking, improve the accuracy of the eye tracking system, and reduce the feature recognition requirements of the eyeball or iris and improve eye tracking.
  • the response time of the system reduces the cost of the eye tracking system, and the eye mark can also be changed according to the actual situation, further improving the accuracy of the eye tracking system.
  • the main purpose of the present invention is to provide an eye tracking system and its use method, which can help the eye tracking by wearing an eye mark on the user, improve the accuracy of the eye tracking system, reduce the feature recognition requirements of the eye or iris, and improve the accuracy of the eye tracking system.
  • the response time reduces the cost of the eye tracking system, and the eye marks can also be changed according to the actual situation, further improving the accuracy of the eye tracking system.
  • the present invention provides an eye tracking system, the system includes: an eye mark, a mark information acquisition module and a processing module,
  • the eye marker is worn by the user on the eyeball for tracking eyeball movement
  • the marking information acquisition module is used to obtain the position information of the user's eye mark
  • the processing module is configured to perform analysis according to the acquired position information of the eyeball mark, and obtain the direction of the user's line of sight.
  • the marker information acquisition module includes a light source and an image acquisition device, and the eye markers are displayed under the irradiation of visible light, ultraviolet light or infrared light.
  • the eye mark includes a transparent display screen for displaying a mark pattern, and the mark pattern is changeable.
  • the eye tracking system further includes a marker analysis module, the marker analysis module is used to analyze suitable eye marker patterns according to user information and external conditions, and the marker analysis module analyzes suitable eye marker patterns through the eye marker model.
  • the eye mark pattern, the eye mark model includes: at least one of face shape, eye shape, eye size, black eye shape, black eye size, pupil shape, pupil size, eyebrow shape, background, light, brightness, and viewing content parameter.
  • the eye tracking system further includes a transmission module, the transmission module sends the obtained information to the server, and the server analyzes the direction of the user's attention and/or the appropriate eye marking pattern, and transmits the result Transmission module to eye tracking system.
  • the eye tracking system combines at least one of the information of body or head orientation, curvature change of the eyeball surface, line of sight change, light intensity, and binocular line of sight focus to analyze the user's line of sight attention direction, and/or adjust at least one personal condition of the user's myopia, hyperopia, presbyopia, and strabismus, so as to obtain more accurate analysis results.
  • the target/position corresponding to the direction of the user's line of sight obtained by the eye tracking system through eye tracking can be used to operate the system or operate the device.
  • the present invention also provides a method for using the eye tracking system as described above, the method comprising:
  • the user wears eye markers
  • the direction of the user's line of sight is obtained.
  • the pattern of the eye marks can be changed.
  • the method further includes analyzing a suitable eye mark pattern through the eye mark model, the eye mark model includes: face shape, eye shape, eye size, black eye shape, black eye size, At least one parameter among pupil shape, pupil size, eyebrow shape, background, light, brightness, and viewing content.
  • the eye tracking system includes: an eye mark, a mark information acquisition module and a processing module.
  • the usage method of the eye tracking system includes: obtaining the user wearing an eye mark; obtaining the position information of the user's eye mark; analyzing the obtained eye mark position information to obtain the direction of the user's line of sight.
  • the eye tracking system and its use method of the present invention can help the eye tracking by wearing an eye mark on the user, improve the accuracy of the eye tracking system, reduce the requirement for feature recognition of the eye or iris, improve the response time of the eye tracking system, and reduce the risk of eye tracking.
  • the cost of the tracking system and the eye mark can also be changed according to the actual situation, further improving the accuracy of the eye tracking system.
  • FIG. 1 is a schematic diagram of an eye tracking system of the present invention.
  • FIG. 2 is a flow chart of a method of using an eye tracking system according to the present invention.
  • FIG. 1 is a schematic diagram of an eye tracking system according to a first embodiment of the present invention.
  • the eye tracking system of the present invention includes: an eye mark 10, a mark information acquisition module 20 and a processing module 30, the eye mark 10 is worn by the user on the eyeball, and is used to locate the position of the user's eyes; the mark information acquisition module 20 It is used to obtain the position information of the user's eye mark; the processing module 30 is used to analyze according to the obtained position information of the eye mark to obtain the direction of the user's line of sight.
  • the eye tracking system of the present invention because the characteristics of the eyeball or iris are required for eye tracking, the image quality and recognition processing capabilities are high, and the thick eyelashes may be mistaken for the pupil, thereby reducing the accuracy of eye tracking or making the eyeball Tracking cannot continue. Therefore, when eye tracking, users are required not to wear eye makeup, and try not to wear glasses with black frames. It may block or be mistaken for the pupil area, which will affect the recognition of the characteristics of the eyeball or iris. Resulting in low eye tracking accuracy.
  • the user wears the eye mark 10, and there is a mark on the eye mark 10 that can help the eye tracking system locate the position of the pupil of the user's eye.
  • the eye mark can overlap with the pupil, or correspond to other positions of the eyeball. Because the position of the eye mark and the pupil is relatively fixed, the movement or position of the mark can reflect the movement and position of the pupil, and then the eye mark can be used to track and locate the direction of attention of the gaze, which can help the eye tracking system to identify and analyze the user's eye movement and get the user's The direction of gaze. And through the direction of the user's line of sight, the area of the user's line of sight can be further obtained, and the position or object of the user's line of sight can be located through the direction of the user's line of sight and the information of each object within the line of sight.
  • the area of the display that the user's line of sight focuses on can be obtained according to the direction of the user's line of sight and the position of the display;
  • the information obtains the objects in the direction that the user's line of sight focuses on, that is, the area that the user's line of sight focuses on.
  • Actual space objects and their location information can be obtained through image acquisition equipment, electronic maps, Internet of Things systems, radar, satellite positioning, etc.
  • the eyeball marker 10 can be an article similar to a contact lens, and can also be directly marked on the contact lens and worn on the user's eyeball. There is a marking pattern on the eyeball marker 10 to help positioning. Marking patterns can be crosshairs, dots, circles, square boxes, arcs, etc., and can also be other patterns that can play a marking role, which is not limited by the present invention.
  • the marking information acquisition module 20 may acquire the position information of the user's eye marks through optical signals. Displayed under infrared light.
  • the marker information acquisition module 20 can also acquire the position information of the user's eye mark through radio signals.
  • the marker information acquisition module 20 includes a radio signal transmitting device and a receiving device, and the eye marker 10 includes a radio signal reflecting device; or the marker information
  • the acquiring module 20 includes a radio signal receiving device, and the eye marker 10 includes a radio signal transmitting device.
  • the eyeball mark 10 may be: an isotope traceable mark, a fluorescent agent traceable mark, a luminescent body traceable mark, an electromagnetic traceable mark, an optical traceable mark, and the like.
  • the marker information acquisition module 20 may be a microwave device or a radar reflection device.
  • the marker information acquisition module 20 may include one or more cameras for acquiring images of the user's eyeballs.
  • the position of the user's eyeball can be obtained by acquiring images from different angles of the user's eye, and then used to analyze the direction of the user's gaze.
  • the image acquired by the marker information acquisition module 20 may include the user's eyes, and may also include the user's face, body and related background.
  • the marker information acquisition module 20 After acquiring the image of the user's eyes, the marker information acquisition module 20 transmits the image to the processing module 30, and the processing module 30 analyzes the acquired image to obtain the direction of the user's attention.
  • the eye tracking system of the present invention can be used not only for pupil-based eye tracking technology, but also for iris-based eye tracking technology. It only needs the eye mark 10 to provide a corresponding mark to help identify and locate, and the present invention does not limit it. .
  • the eye mark 10 can provide marks of patterns such as crosshairs, dots, circles, etc., to help the processing module 30 better identify the user's pupil, and then analyze the direction of the user's attention; and for the iris-based With the eye tracking technology, the eye mark 10 can provide patterns such as arcs and boxes to help the processing module 30 better identify the user's iris, and then analyze the direction of the user's gaze.
  • patterns such as crosshairs, dots, circles, etc.
  • the eye markings 10 are displayed under visible light or under infrared light irradiation.
  • a suitable eye mark pattern according to user information and/or external conditions, so as to increase the accuracy of eye tracking.
  • the eye mark pattern suitable for the user can be analyzed.
  • the appropriate eyeball pattern can also be further analyzed according to the background, light, brightness, and content the user is watching.
  • the eye tracking system of the present invention may further include a marker analysis module for analyzing suitable eye marker patterns according to user information and external conditions. Suitable eye mark patterns include suitable pattern shapes and colors.
  • an eyeball model can also be established to help analyze and calculate an eyeball pattern suitable for the user.
  • the eyeball marking model is used to analyze suitable eyeball marking patterns.
  • the eyeball marking model can include: face shape, eye shape, eye size, black eyeball shape, black eyeball size, pupil shape, pupil size, eyebrow shape, background, light, Brightness, at least one parameter of viewing content, may also include other parameters related to eye tracking.
  • the parameters can also be obtained by experts based on industry standards, or by users through actual use, or by artificial intelligence through big data analysis, or by a combination of the above methods.
  • the establishment of the eye marking model can first classify the existing data based on user groups with different eye types, establish eye marking models of different classifications, and then gradually refine them to make the classification of user groups more and more refined. A model of an individual user.
  • the eye mark model can be based on the user's individual information and external conditions of use, and based on the user's basic information, user face shape, eye shape, eye size, black eye shape, black eye size, pupil shape, pupil size , eyebrow shape, crowd information, genetic related information, indicators, feelings, physical condition, physiological development information, marriage and childbearing information, physiological condition, psychological/intellectual condition, life/work/study/sports/entertainment information, environmental information, drug/ Information related to the use of medical devices/health products/cosmetics, different observation habits, facial expressions, eyesight, field of vision and other elements are established.
  • the establishment and classification of the eye mark model can be established manually based on professional/authoritative research results, literature, data, and experience, or it can be established based on information reorganization/information analysis/big data analysis, or it can be established through artificial intelligence deep learning
  • the establishment can also be established through data mining and analysis, and the model can also be continuously adjusted and improved during the use process.
  • a suitable eyeball pattern can be obtained by analyzing user information, external conditions, and an eyeball model.
  • User information may include: basic information, user face shape, eye shape, eye size, black eye shape, black eye size, pupil shape, pupil size, eyebrow shape, crowd information, genetic related information, indicators, feelings, physical conditions, observation habits . /metabolism/vision/hearing/intelligence/attention/diet/immunity/growth/development/memory/fertility status and schedule and other information.
  • External conditions may include: the background of the human body, light, brightness, viewing content, clarity, color difference, hue, etc.
  • the eye mark 10 can also be a contact lens including a transparent display screen.
  • the eye marker 10 includes a transparent display screen for displaying a marker pattern, which is changeable.
  • the transparent display screen is a display screen with higher light transmittance, and the eye mark 10 adopts a contact lens including a transparent display screen, and the transparent display screen can be used to display eye mark patterns suitable for user information and external conditions, and due to the light transmittance High, it may not affect or less affect the user's own visual experience.
  • the transparent display screen can be controlled by an eye tracking system or a mobile phone or other smart devices, and the eye mark pattern can be changed and adjusted at any time to suit different user information and external conditions.
  • the eye tracking system of the present invention can also combine the orientation of the body or head, the curvature of the surface of the eye, the change of the line of sight, the intensity of light and the focus and/or
  • the user's personal conditions such as myopia, hyperopia, presbyopia, and strabismus are adjusted to obtain more accurate analysis results.
  • the eye tracking system of the present invention can obtain the direction of the user's line of sight according to the eye marks of a single eye, and can also use the eye marks of both eyes to work together.
  • the eye marks of both eyes can analyze the attention direction of the two eyes based on the two eye marks, or it can analyze the direction and position of the focus of the user's sight based on the physiological data model of the focus of the user's two eyes. , distance and other information.
  • the physiological data model of the focus of the user's eyes can be established through the user's line of sight/vision test data.
  • the target/position corresponding to the direction of attention of the user's line of sight obtained through eye tracking can be used to operate the system or operate the device.
  • cursor movement, object selection, location selection, information transmission, etc. can be operated according to eye tracking results.
  • the eye tracking results can be used in VR shooting games, and the aimer of the sight can be moved according to the eye tracking results to bring users a better experience, and so on.
  • the eye tracking system of the present invention may also include a transmission module, the transmission module sends the obtained information to the server, and the server analyzes the direction of the user's sight focus and/or the appropriate eye mark pattern, and transmits the result to the eye tracking system.
  • Transport module Using an external server to analyze the direction of the user's gaze and/or the appropriate eye mark pattern can further reduce the performance requirements of the eye tracking system and reduce the cost of the eye tracking system.
  • FIG. 2 is a flow chart of a method for using an eye tracking system according to a second embodiment of the present invention.
  • the usage method of the eye tracking system of the present invention includes:
  • S1 The user wears eye markers
  • S3 Analyze according to the acquired position information of the eye mark, and obtain the direction of the user's gaze.
  • the pattern of the eye mark is displayed on a transparent display screen, and the pattern is changeable.
  • the method for using the eye tracking system of the present invention may also include analyzing a suitable eye mark pattern through an eye mark model, and the eye mark model includes: face shape, eye shape, eye size, black eye shape, black eye size, pupil shape, At least one parameter among pupil size, eyebrow shape, background, light, brightness, and viewing content.
  • the method for using the eye tracking system of the present invention corresponds to the technical features of the eye tracking system of the present invention one by one, and reference can be made to the description of the aforementioned eye tracking system, which will not be repeated here.
  • the present invention provides an eye tracking system and a method for using the same.
  • the eye tracking system includes: an eye mark, a mark information acquisition module and a processing module.
  • the usage method of the eye tracking system includes: obtaining the user wearing an eye mark; obtaining the position information of the user's eye mark; analyzing the obtained eye mark position information to obtain the direction of the user's line of sight.
  • the eye tracking system and its use method of the present invention can help the eye tracking by wearing an eye mark on the user, improve the accuracy of the eye tracking system, reduce the requirement for feature recognition of the eye or iris, improve the response time of the eye tracking system, and reduce the risk of eye tracking.
  • the cost of the tracking system and the eye mark can also be changed according to the actual situation, further improving the accuracy of the eye tracking system.

Abstract

一种眼球追踪系统及其使用方法，眼球追踪系统包括：眼球标记（10）、标记信息获取模块（20）和处理模块（30）。眼球追踪系统的使用方法包括：获用户佩戴眼球标记（10）（S1）；获取用户眼球标记（10）的位置信息（S2）；根据获取的眼球标记（10）位置信息进行分析，得到用户视线关注的方向（S3）。眼球追踪系统及其使用方法，通过用户佩戴眼球标记（10）帮助眼球追踪，提高眼球追踪系统的精度，并且可以降低眼球或虹膜的特征识别要求，提高眼球追踪系统的响应时间，降低眼球追踪系统的成本，眼球标记（10）还可以是根据实际情况变化的，进一步提高眼球追踪系统的精度。

Description

一种眼球追踪系统及其使用方法 技术领域
本发明涉及信息通讯技术领域，特别是涉及一种眼球追踪系统及其使用方法。
背景技术
随着人机交互技术的发展，在智能手机、平板电脑等智能终端中，已经实现了通过眼球追踪来进行如控制电子书翻页、网页滚屏等简单的操作。目前，眼球追踪技术主要体现在三个方面：一是根据眼球和眼球周边的特征变化进行追踪；二是根据虹膜角度变化进行追踪；三是主动投射红外线等光束到虹膜来提取特征。其中，主动投射红外线等光束到虹膜来提取特征的眼球追踪技术具有较好的精确度，在基于眼球追踪的人机交互领域已经得到了较为广泛的应用。
但是，在现有的眼球追踪技术中，由于需要眼球或虹膜的特征来进行眼球追踪，对图像质量及识别处理能力要求高，若眼球追踪系统或眼球因处于颠簸环境下，则会导致影像获取模块捕捉到眼球图像存在拖影等缺陷，进而影响识别眼球或虹膜的特征，导致眼球追踪精度低。
因此，迫切需要一种精度高、要求低的眼球追踪系统及其使用方 法，通过用户佩戴眼球标记帮助眼球追踪，提高眼球追踪系统的精度，并且可以降低眼球或虹膜的特征识别要求，提高眼球追踪系统的响应时间，降低眼球追踪系统的成本，眼球标记还可以是根据实际情况变化的，进一步提高眼球追踪系统的精度。
发明内容
本发明的主要目的是：提供一种眼球追踪系统及其使用方法，通过用户佩戴眼球标记帮助眼球追踪，提高眼球追踪系统的精度，并且可以降低眼球或虹膜的特征识别要求，提高眼球追踪系统的响应时间，降低眼球追踪系统的成本，眼球标记还可以是根据实际情况变化的，进一步提高眼球追踪系统的精度。
为实现上述目的，本发明提供了一种眼球追踪系统，所述系统包括：眼球标记、标记信息获取模块和处理模块，
所述眼球标记由用户戴在眼球上，用于眼球移动的示踪；
所述标记信息获取模块用于获取用户眼球标记的位置信息；
所述处理模块用于根据获取的眼球标记位置信息进行分析，得到用户视线关注的方向。
如上所述的眼球追踪系统，所述标记信息获取模块包括光源和影 像获取装置，所述眼球标记是在可见光、紫外光或红外光照射下显示。
如上所述的眼球追踪系统，所述眼球标记包括透明显示屏，用于显示标记图案，所述标记图案是可变化的。
如上所述的眼球追踪系统，所述眼球追踪系统还包括标记分析模块，所述标记分析模块用于根据用户信息和外部条件分析适合的眼球标记图案，所述标记分析模块通过眼球标记模型分析适合的眼球标记图案，所述眼球标记模型包括：脸型、眼睛形状、眼睛大小、黑眼球形状、黑眼球大小、瞳孔形状、瞳孔大小、眉毛形态、背景、光线、亮度、观看内容中的至少一项参数。
如上所述的眼球追踪系统，所述眼球追踪系统还包括传输模块，所述传输模块将获取的信息发送至服务器，服务器分析用户视线关注的方向和/或适合的眼球标记图案，并将结果传输至眼球追踪系统的传输模块。
如上所述的眼球追踪系统，所述眼球追踪系统结合身体或头部的方位、眼球表面的曲度变化、视线的变化、光线的强弱、双眼视线聚焦中的至少一项信息分析用户视线关注的方向，与/或对用户的近视、远视、老花、斜视中的至少一项个人情况进行调整，从而得到更精确的分析结果。
如上所述的眼球追踪系统，所述眼球追踪系统通过眼球追踪得到的用户视线关注方向对应的目标/位置，可用于对系统进行操作或对 设备进行操作。
本发明还提供一种如上所述的眼球追踪系统的使用方法，所述方法包括：
用户佩戴眼球标记；
获取用户眼球标记的位置信息；
根据获取的眼球标记位置信息进行分析，得到用户视线关注的方向。
如上所述的眼球追踪系统的使用方法，所述眼球标记的图案是可变化的。
如上所述的眼球追踪系统的使用方法，所述方法还包括通过眼球标记模型分析适合的眼球标记图案，所述眼球标记模型包括：脸型、眼睛形状、眼睛大小、黑眼球形状、黑眼球大小、瞳孔形状、瞳孔大小、眉毛形态、背景、光线、亮度、观看内容中的至少一项参数。
本发明的一种眼球追踪系统及其使用方法，眼球追踪系统包括：眼球标记、标记信息获取模块和处理模块。眼球追踪系统的使用方法包括：获用户佩戴眼球标记；获取用户眼球标记的位置信息；根据获取的眼球标记位置信息进行分析，得到用户视线关注的方向。本发明的一种眼球追踪系统及其使用方法，通过用户佩戴眼球标记帮助眼球追踪，提高眼球追踪系统的精度，并且可以降低眼球或虹膜的特征识 别要求，提高眼球追踪系统的响应时间，降低眼球追踪系统的成本，眼球标记还可以是根据实际情况变化的，进一步提高眼球追踪系统的精度。
附图说明
图1为本发明一种眼球追踪系统的示意图。
图2为本发明一种眼球追踪系统的使用方法的方法流程图。
具体实施方式
为进一步阐述本发明达成预定目的所采取的技术手段及功效，以下结合附图及实施例，对本发明的具体实施方式，详细说明如下。
本发明第一实施例参阅图1。图1为本发明第一实施例一种眼球追踪系统的示意图。如图所示，本发明的眼球追踪系统包括：眼球标记10、标记信息获取模块20和处理模块30，眼球标记10由用户戴在眼球上，用于定位用户眼睛的位置；标记信息获取模块20用于获取用户眼球标记的位置信息；处理模块30用于根据获取的眼球标记位置信息进行分析，得到用户视线关注的方向。
现有的眼球追踪技术中，由于需要眼球或虹膜的特征来进行眼球 追踪，对影像质量及识别处理能力要求高，并且浓厚的眼睫毛有可能会被误认为瞳孔，从而降低眼球追踪精度或使眼球追踪无法继续进行，因而在眼球追踪时，要求用户不要化眼部妆，尽可能的不戴有黑色镜框的眼镜，它可能会遮挡或被误认为瞳孔区域，进而影响识别眼球或虹膜的特征，导致眼球追踪精度低。而本发明的眼球追踪系统，通过用户佩戴眼球标记10，眼球标记10上有可以帮助眼球追踪系统定位用户眼睛瞳孔的位置的标记，眼球标记可以和瞳孔重叠，也可以是对应在眼球其他位置，因为眼球标记与瞳孔的位置相对固定，标记的移动或位置可以反映瞳孔的移动和位置，进而通过眼球标记实现对视线关注方向的追踪和定位，可以帮助眼球追踪系统识别分析用户眼球动作，得到用户视线关注的方向。而通过用户视线关注的方向，还可以进一步得到用户视线关注的区域，可以是通过用户视线方向，和视线范围内的各物体信息，定位到用户视线关注的位置或对象。例如：用户看显示器、VR眼镜等显示屏，可以根据用户视线方向和显示屏位置得出用户视线关注的显示屏的区域；用户看实际空间时，可以根据用户视线方向和实际空间内物体的位置信息得出用户视线关注的方向上的物体，即用户视线关注的区域。实际空间物体及其位置信息可以是通过影像采集设备、电子地图、物联网系统、雷达、卫星定位等方式获取。
眼球标记10可以是类似隐形眼镜的物品，也可以直接标记在隐形眼镜上，佩戴在用户的眼球上，眼球标记10上有标记图案，帮助定位。标记图案可以是十字线、点、圆圈、方框、圆弧等，还可以是 其他可以起到标记作用的图案，本发明不做限制。
在本发明中，标记信息获取模块20可以是通过光信号来获取用户眼球标记的位置信息，此时，标记信息获取模块20包括光源和影像获取装置，所述眼球标记是在可见光、紫外光或红外光照射下显示。标记信息获取模块20也可以是通过无线电信号来获取用户眼球标记的位置信息，此时，标记信息获取模块20包括无线电信号发射装置和接收装置，眼球标记10包括无线电信号反射装置；或者是标记信息获取模块20包括无线电信号接收装置，眼球标记10包括无线电信号发射装置。眼球标记10可以是：同位素示踪标记、荧光剂示踪标记、发光体示踪标记、电磁示踪标记、光学示踪标记等。标记信息获取模块20可以是微波装置或雷达反射装置。
在本发明中，标记信息获取模块20可以包括一个或以上摄像头，用于获取用户眼球的影像。可以是通过获取用户眼睛不同角度的影像，得出用户眼球位置，进而用于分析用户视线关注的方向。在本发明中，标记信息获取模块20获取的影像可以包括用户的眼部，还可以包括用户的面部、身体和相关背景。
获取用户眼睛的影像后，标记信息获取模块20将影像传输至处理模块30，由处理模块30根据获取的影像进行分析，得到用户视线关注的方向。本发明的眼球追踪系统，既可以用于基于瞳孔的眼球追踪技术，也可以用于基于虹膜的眼球追踪技术，只需要眼球标记10提供相应的帮助识别定位的标记即可，本发明不做限制。例如：对于 基于瞳孔的眼球追踪技术，眼球标记10可以提供十字线、点、圆圈等图案的标记，帮助处理模块30更好的识别用户瞳孔，进而分析用户视线关注的方向；而对于基于虹膜的眼球追踪技术，眼球标记10可以提供圆弧、方框等图案的标记，帮助处理模块30更好的识别用户虹膜，进而分析用户视线关注的方向。
本发明的眼球追踪系统，为了减少眼球标记对人眼看物体的影响，以及提高识别精度的需要，眼球标记10是在可见光下显示，也可以是在红外光照射下显示。
为了进一步提高眼球追踪的精度，还可以针对用户信息和/或外部条件，采用适合的眼球标记图案，使眼球追踪的精度更高。可以根据用户脸型、眼睛形状、眼睛大小、黑眼球形状、黑眼球大小、瞳孔形状、瞳孔大小、眉毛形态等信息，分析出适合用户的眼球标记图案。还可以根据用户所处的背景、光线、亮度、以及用户观看的内容，进一步分析适合的眼球标记图案。本发明的眼球追踪系统，还可以包括标记分析模块，所述标记分析模块用于根据用户信息和外部条件分析适合的眼球标记图案。适合的眼球标记图案包括适合的图案形状和颜色。
在本发明中，还可以通过建立眼球标记模型来帮助分析计算适合用户的眼球标记图案。所述眼球标记模型是用于分析适合的眼球标记图案，眼球标记模型可以包括：脸型、眼睛形状、眼睛大小、黑眼球形状、黑眼球大小、瞳孔形状、瞳孔大小、眉毛形态、背景、光线、 亮度、观看内容中的至少一项参数，还可以包括其他与眼球追踪有关的参数。参数也可以是由专家依据行业标准得出，或者是由用户经过实际使用得出，还可以是由人工智能通过大数据分析得出，或者通过上述方法的组合得出。眼球标记模型的建立可以先对已有数据基于不同眼型的用户群体来分类，建立不同分类的眼球标记模型，再慢慢细化，使用户群体分类越来越细化，最终，建立针对每个个人用户的模型。
眼球标记模型对于不同的情况，可以基于用户的个体化信息及外部的使用条件，并基于用户的基本信息、用户脸型、眼睛形状、眼睛大小、黑眼球形状、黑眼球大小、瞳孔形状、瞳孔大小、眉毛形态、人群信息、遗传相关信息、指标、感受、身体状况、生理发育信息、婚育信息、生理状况、心理/智力状况、生活/工作/学习/运动/娱乐信息、环境信息、药物/医疗器械/保健品/化妆品使用相关信息，不同的观察习惯、面部表情、视力、视野等各项要素而建立。眼球标记模型的建立和分类可以是基于专业性/权威性的研究结果、文献、资料、经验由人工建立，也可以基于信息重整/信息分析/大数据分析建立，也可以通过人工智能深度学习建立，还可以通过数据挖据分析后建立，模型也可以在使用过程中不断调整及完善。
适合的眼球标记图案可以根据用户信息、外部条件、及眼球标记模型分析得出。用户信息可以包括：基本信息、用户脸型、眼睛形状、眼睛大小、黑眼球形状、黑眼球大小、瞳孔形状、瞳孔大小、眉毛形 态、人群信息、遗传相关信息、指标、感受、身体状况、观察习惯、面部表情、视力、视野、学习情况、工作情况、运动情况、家庭情况、生活环境、兴趣爱好、依从性情况、耐受情况、以及生理/心理/学习/工作/体能/睡眠/运动/情绪/代谢/视力/听力/智力/注意力/饮食/免疫/生长发育/记忆力/生育能力状况和作息时间等信息。外部条件可以包括：人体所处的背景、光线、亮度、观看的内容、清晰度、色差、色调等。
分析出并采用适合的眼球标记图案，可以进一步提高眼球追踪的精度。而为了适应不同的用户信息和外部条件所对应的适合的眼球标记图案，在本发明中，眼球标记10还可以采用包括透明显示屏的隐形眼镜。眼球标记10包括透明显示屏，用于显示标记图案，所述标记图案是可变化的。透明显示屏是一种透光率更高的显示屏，眼球标记10采用包括透明显示屏的隐形眼镜，可以使用透明显示屏来显示适合用户信息和外部条件的眼球标记图案，并且由于透光率高，可以不影响或少影响用户自身的视觉体验。而透明显示屏可以受到眼球追踪系统或手机或其他智能设备的控制，随时变换调整眼球标记图案，适合不同的用户信息和外部条件。
本发明的眼球追踪系统，在分析用户视线关注的方向时，还可以结合身体或头部的方位，以及眼球表面的曲度变化、视线的变化、结合光线的强弱和双眼视线聚焦与/或用户的近视、远视、老花、斜视等个人情况进行调整，从而得到更精确的分析结果。
本发明的眼球追踪系统，可以依据单眼的眼球标记得到用户视线关注的方向，也可以是通过双眼的眼球标记协同发挥作用。当双眼的眼球标记共同发挥作用时，可以是根据两个眼球标记分别分析出两只眼睛的视线关注方向，也可以是根据用户两眼聚焦的生理数据模型，分析出用户视线焦点的方向、位置、距离等信息。用户两眼聚焦的生理数据模型可以是通过用户视线/视力测试数据建立。
本发明的眼球追踪系统，通过眼球追踪得到的用户视线关注方向对应的目标/位置，可以用于对系统进行操作或对设备进行操作。例如：可以根据眼球追踪结果操作光标移动、选择对象、选择位置、传递信息等等。比如，可以将眼球追踪结果用于VR射击游戏，根据眼球追踪结果移动瞄准器的准星，带给用户更好的体验感，等等。
本发明的眼球追踪系统，还可以包括传输模块，所述传输模块将获取的信息发送至服务器，服务器分析用户视线关注的方向和/或适合的眼球标记图案，并将结果传输至眼球追踪系统的传输模块。通过外部服务器来完成分析用户视线关注的方向和/或适合的眼球标记图案，可以进一步降低眼球追踪系统的性能要求，降低眼球追踪系统的成本。
本发明第二实施例参阅图2。图2为本发明第二实施例一种眼球追踪系统的使用方法的方法流程图。如图所示，本发明的眼球追踪系统的使用方法包括：
S1：用户佩戴眼球标记；
S2：获取用户眼球标记的位置信息；
S3：根据获取的眼球标记位置信息进行分析，得到用户视线关注的方向。
本发明的眼球追踪系统的使用方法，所述眼球标记的图案采用透明显示屏显示，图案是可变化的。
本发明的眼球追踪系统的使用方法，还可以包括通过眼球标记模型分析适合的眼球标记图案，所述眼球标记模型包括：脸型、眼睛形状、眼睛大小、黑眼球形状、黑眼球大小、瞳孔形状、瞳孔大小、眉毛形态、背景、光线、亮度、观看内容中的至少一项参数。
本发明的一种眼球追踪系统的使用方法与本发明的一种眼球追踪系统的技术特征一一对应，可以参照前述一种眼球追踪系统的说明，在此不再赘述。
综上所述，本发明的一种眼球追踪系统及其使用方法，眼球追踪系统包括：眼球标记、标记信息获取模块和处理模块。眼球追踪系统的使用方法包括：获用户佩戴眼球标记；获取用户眼球标记的位置信息；根据获取的眼球标记位置信息进行分析，得到用户视线关注的方向。本发明的一种眼球追踪系统及其使用方法，通过用户佩戴眼球标记帮助眼球追踪，提高眼球追踪系统的精度，并且可以降低眼球或虹 膜的特征识别要求，提高眼球追踪系统的响应时间，降低眼球追踪系统的成本，眼球标记还可以是根据实际情况变化的，进一步提高眼球追踪系统的精度。
以上所述的具体实施方式，对本发明的目的、技术方案和有益效果进行了进一步详细说明，所应理解的是，以上所述仅为本发明的具体实施方式而已，并不用于限定本发明的保护范围，凡在本发明的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。

Claims (10)

  1. 一种眼球追踪系统，其特征在于，所述系统包括：眼球标记、标记信息获取模块和处理模块，
    所述眼球标记由用户戴在眼球上，用于眼球移动的示踪；
    所述标记信息获取模块用于获取用户眼球标记的位置信息；
    所述处理模块用于根据获取的眼球标记位置信息进行分析，得到用户视线关注的方向。
  2. 根据权利要求1所述的眼球追踪系统，其特征在于：所述标记信息获取模块包括光源和影像获取装置，所述眼球标记是在可见光、紫外光或红外光照射下显示。
  3. 根据权利要求1所述的眼球追踪系统，其特征在于：所述眼球标记包括透明显示屏，用于显示标记图案，所述标记图案是可变化的。
  4. 根据权利要求1所述的眼球追踪系统，其特征在于：所述眼球追踪系统还包括标记分析模块，所述标记分析模块用于根据用户信息和外部条件分析适合的眼球标记图案，所述标记分析模块通过眼球标记模型分析适合的眼球标记图案，所述眼球标记模型包括：脸型、眼睛形状、眼睛大小、黑眼球形状、黑眼球大小、瞳孔形状、瞳孔大小、眉毛形态、背景、光线、亮度、观看内容中的至 少一项参数。
  5. 根据权利要求1所述的眼球追踪系统，其特征在于：所述眼球追踪系统还包括传输模块，所述传输模块将获取的信息发送至服务器，服务器分析用户视线关注的方向和/或适合的眼球标记图案，并将结果传输至眼球追踪系统的传输模块。
  6. 根据权利要求1所述的眼球追踪系统，其特征在于：所述眼球追踪系统结合身体或头部的方位、眼球表面的曲度变化、视线的变化、光线的强弱、双眼视线聚焦中的至少一项信息分析用户视线关注的方向，与/或对用户的近视、远视、老花、斜视中的至少一项个人情况进行调整，从而得到更精确的分析结果。
  7. 根据权利要求1所述的眼球追踪系统，其特征在于：所述眼球追踪系统通过眼球追踪得到的用户视线关注方向对应的目标/位置，可用于对系统进行操作或对设备进行操作。
  8. 一种如权利要求1-7中任一权利要求所述的眼球追踪系统的使用方法，其特征在于，所述方法包括：
    用户佩戴眼球标记；
    获取用户眼球标记的位置信息；
    根据获取的眼球标记位置信息进行分析，得到用户视线关注的方向。
  9. 根据权利要求8所述的方法，其特征在于：所述眼球标记的图案是可变化的。
  10. 根据权利要求8所述的方法，其特征在于：所述方法还包括通过眼球标记模型分析适合的眼球标记图案，所述眼球标记模型包括：脸型、眼睛形状、眼睛大小、黑眼球形状、黑眼球大小、瞳孔形状、瞳孔大小、眉毛形态、背景、光线、亮度、观看内容中的至少一项参数。
PCT/CN2022/078113 2022-02-25 2022-02-25 一种眼球追踪系统及其使用方法 WO2023159526A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2022/078113 WO2023159526A1 (zh) 2022-02-25 2022-02-25 一种眼球追踪系统及其使用方法
CN202280000283.2A CN114787755A (zh) 2022-02-25 2022-02-25 一种眼球追踪系统及其使用方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/078113 WO2023159526A1 (zh) 2022-02-25 2022-02-25 一种眼球追踪系统及其使用方法

Publications (1)

Publication Number Publication Date
WO2023159526A1 true WO2023159526A1 (zh) 2023-08-31

Family

ID=82422249

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/078113 WO2023159526A1 (zh) 2022-02-25 2022-02-25 一种眼球追踪系统及其使用方法

Country Status (2)

Country Link
CN (1) CN114787755A (zh)
WO (1) WO2023159526A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080024722A1 (en) * 2006-07-27 2008-01-31 Sony Computer Entertainment America Inc. Contact lenses for use in motion capture
CN106708251A (zh) * 2015-08-12 2017-05-24 天津电眼科技有限公司 一种基于眼球追踪技术的智能眼镜控制方法
CN108227239A (zh) * 2016-12-15 2018-06-29 索尼移动通讯有限公司 智能隐形眼镜以及包括该智能隐形眼镜的多媒体系统
CN108664118A (zh) * 2017-03-27 2018-10-16 腾讯科技（深圳）有限公司 眼球追踪方法和装置、隐形眼镜、虚拟现实系统
US20190274543A1 (en) * 2016-05-13 2019-09-12 Erasmus University Medical Center Rotterdam Method for measuring a subject's eye movement and scleral contact lens
CN113688733A (zh) * 2021-08-25 2021-11-23 深圳龙岗智能视听研究院 基于事件相机的眼部检测和追踪方法、系统、设备及应用

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080024722A1 (en) * 2006-07-27 2008-01-31 Sony Computer Entertainment America Inc. Contact lenses for use in motion capture
CN106708251A (zh) * 2015-08-12 2017-05-24 天津电眼科技有限公司 一种基于眼球追踪技术的智能眼镜控制方法
US20190274543A1 (en) * 2016-05-13 2019-09-12 Erasmus University Medical Center Rotterdam Method for measuring a subject's eye movement and scleral contact lens
CN108227239A (zh) * 2016-12-15 2018-06-29 索尼移动通讯有限公司 智能隐形眼镜以及包括该智能隐形眼镜的多媒体系统
CN108664118A (zh) * 2017-03-27 2018-10-16 腾讯科技（深圳）有限公司 眼球追踪方法和装置、隐形眼镜、虚拟现实系统
CN113688733A (zh) * 2021-08-25 2021-11-23 深圳龙岗智能视听研究院 基于事件相机的眼部检测和追踪方法、系统、设备及应用

Also Published As

Publication number Publication date
CN114787755A (zh) 2022-07-22

Similar Documents

Publication Publication Date Title
EP2710516B1 (en) Systems and methods for identifying gaze tracking scene reference locations
US11556741B2 (en) Devices, systems and methods for predicting gaze-related parameters using a neural network
EP3750028B1 (en) Devices, systems and methods for predicting gaze-related parameters
CN105164576B (zh) 对适配于佩戴者的头戴式电光设备进行控制的方法
US11393251B2 (en) Devices, systems and methods for predicting gaze-related parameters
CN104090371B (zh) 一种3d眼镜及3d显示系统
CN108139806A (zh) 相对于可穿戴设备跟踪穿戴者的眼睛
CN111603134B (zh) 眼球运动测试的装置及方法
EP3453317B1 (en) Pupil radius compensation
CN104603673A (zh) 头戴式系统以及使用头戴式系统计算和渲染数字图像流的方法
CN107077593A (zh) 用于显示屏增强的系统和方法
CN107260506B (zh) 基于眼动的3d视觉训练系统、智能终端及头戴设备
US20210019493A1 (en) Information processing apparatus, information processing method, and program
JP2022547893A (ja) 視覚シーンを投影面上へマッピングする装置および方法
Lander et al. hEYEbrid: A hybrid approach for mobile calibration-free gaze estimation
CN104483754A (zh) 针对视觉障碍患者的头戴式多媒体终端辅助观看系统
WO2023159526A1 (zh) 一种眼球追踪系统及其使用方法
CN115185365A (zh) 一种无线控制的眼睛控制系统及其控制方法
CN203882018U (zh) 一种3d眼镜及3d显示系统
US20220198789A1 (en) Systems and methods for determining one or more parameters of a user's eye
CN218413524U (zh) 眼部追踪装置及智能眼镜
MP et al. Method for increasing the accuracy of tracking the center of attention of the gaze
Vora et al. Gaze-contingent Screen Adjustment
CN115137293A (zh) 用于确定参考注视数据的系统和方法
WO2023096713A1 (en) Personalized optics

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22927809

Country of ref document: EP

Kind code of ref document: A1