WO2020010868A1 - Line-of-sight detection method and device, apparatus, and storage medium - Google Patents

Line-of-sight detection method and device, apparatus, and storage medium Download PDF

Info

Publication number
WO2020010868A1
WO2020010868A1 PCT/CN2019/078023 CN2019078023W WO2020010868A1 WO 2020010868 A1 WO2020010868 A1 WO 2020010868A1 CN 2019078023 W CN2019078023 W CN 2019078023W WO 2020010868 A1 WO2020010868 A1 WO 2020010868A1
Authority
WO
WIPO (PCT)
Prior art keywords
eye
sight
data
vision
line
Prior art date
Application number
PCT/CN2019/078023
Other languages
French (fr)
Chinese (zh)
Inventor
路伟成
秦林婵
黄通兵
Original Assignee
北京七鑫易维信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京七鑫易维信息技术有限公司 filed Critical 北京七鑫易维信息技术有限公司
Publication of WO2020010868A1 publication Critical patent/WO2020010868A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0091—Fixation targets for viewing direction
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
    • A61B3/08—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing binocular or stereoscopic vision, e.g. strabismus
    • A61B3/085—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing binocular or stereoscopic vision, e.g. strabismus for testing strabismus

Definitions

  • the embodiments of the present application relate to the technical field of sight detection, and in particular, to a method, a device, a device, and a storage medium for detecting sight of an eye.
  • the relationship between certain eye features of a specific user and the direction of the line of sight of the user needs to be determined first. In this way, the direction of the line of sight of the user can be obtained through this relationship in the subsequent process.
  • This relationship is called the line-of-sight calibration coefficient, which can also be called the line-of-sight calibration parameter.
  • the line-of-sight direction data obtained by using the calibration coefficients obtained by conventional means is the line-of-sight direction of the user's subjective intention observation, rather than the true line-of-sight direction of each eye of the user.
  • This method obtains the user's subjective line of sight, so it can be used for functions such as interaction.
  • we want to obtain the user's true line of sight For example, in the process of diagnosing or rehabilitating patients with amblyopia or strabismus, we want to obtain the true line of sight data of the patient, rather than the subjective line of sight data.
  • the conventional method cannot obtain accurate sight data, and the present application was made to solve the above problems.
  • the embodiments of the present application provide a method, a device, a device, and a storage medium for detecting the sight of an eye, which can improve the accuracy of detecting the sight of an eye.
  • an embodiment of the present application provides a method for detecting eye gaze.
  • the method includes:
  • the sight line calibration coefficients including a left eye sight line calibration coefficient and a right eye sight line calibration coefficient
  • binocular vision data of a user is obtained according to the vision calibration coefficient; the binocular vision data includes left-eye vision data and right-eye vision data.
  • the method further includes comparing the binocular vision data with the standard vision data to obtain a detection result.
  • obtaining the sight line calibration coefficients of both eyes of the user separately includes:
  • the left-eye eyeball tracking module is used to calibrate the left eye to obtain the left-eye sight calibration coefficient
  • the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
  • acquiring binocular vision data of a user according to the vision calibration coefficient includes:
  • the set visual stimulus elements are displayed at different positions of the visual field, the left eyeball tracking module is used to track the left eyeball, and the left eye sight data is obtained based on the left eye sight calibration coefficient;
  • the right-eye eyeball tracking module is used to track the right-eye eyeball, and right-eye vision data is obtained based on the right-eye vision calibration coefficient.
  • comparing the binocular sight data with standard sight data to obtain a detection result includes:
  • comparing the left-eye sight data with standard left-eye sight data and comparing the right-eye sight data with standard right-eye sight data to obtain a detection result includes:
  • the detection result is that the user's eyes are normal
  • the detection result is that the left eye of the user is abnormal
  • the detection result is that the user's right eye is abnormal
  • the detection result is that the user's eyes are abnormal.
  • an embodiment of the present application further provides an eye sight detection device, where the device includes:
  • the line-of-sight calibration coefficient acquisition module is configured to obtain the line-of-sight calibration coefficients of both eyes of the user under monocular vision, where the line-of-sight calibration coefficients include a left-eye line of sight calibration coefficient and a right-eye line of sight calibration coefficient;
  • the binocular sight data acquisition module is configured to obtain binocular sight data of a user according to the sight calibration coefficient under binocular vision; the binocular sight data includes left-eye sight data and right-eye sight data.
  • the line-of-sight calibration coefficient acquisition module is further configured to:
  • the left-eye eyeball tracking module is used to calibrate the left eye to obtain the left-eye sight calibration coefficient
  • the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
  • the binocular sight data acquisition module is further configured to:
  • the set visual stimulus elements are displayed at different positions in the visual field, the left eyeball tracking module is used to track the left eyeball, and the left eyesight data is obtained based on the left eyesight calibration coefficient;
  • the right-eye eyeball tracking module is used to track the right-eye eyeball, and right-eye vision data is obtained based on the right-eye vision calibration coefficient.
  • an embodiment of the present application further provides a mobile device, including a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the processor executes the program, the implementation is implemented as in the present application.
  • the method for detecting the sight of the eye according to the embodiment.
  • an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the method for detecting an eye sight according to the embodiment of the present application is implemented.
  • the eyesight calibration coefficients of the user's two eyes are separately obtained in monocular vision, and then the binocular vision data of the user are obtained according to the eyesight calibration coefficient in the binocular vision.
  • the eye sight detection method provided in the embodiment of the present application can improve the accuracy of eye sight detection by detecting the eye sight of the user by using the eye tracking module.
  • FIG. 1 is a flowchart of an eye sight detection method provided in Embodiment 1 of the present application;
  • Embodiment 2 is a flowchart of another eye sight detection method provided in Embodiment 1 of the present application.
  • FIG. 3 is a schematic structural diagram of an eye sight detection device provided in Embodiment 2 of the present application.
  • FIG. 4 is a schematic structural diagram of a mobile device provided in Embodiment 3 of the present application.
  • Eye tracking can also be called gaze tracking, which is a technique that estimates eye sight and / or gaze point by measuring eye movements.
  • the line of sight can be understood as a three-dimensional vector
  • the fixation point can be understood as the two-dimensional coordinates of the three-dimensional vector projected on a certain plane.
  • the tracking of the eyeball can be implemented by an optical recording method.
  • the principle of the optical recording method is to use a camera or a video camera to record the eye movement of the test subject, that is, to obtain an eye image that can reflect the eye movement, and extract eye features from the obtained eye image for establishing sight / fixation points.
  • the eye features may include: pupil position, pupil shape, iris position, iris shape, eyelid position, eye corner position, light spot position (or Purchin spot), and the like.
  • Optical recording methods include pupil-corneal reflection method.
  • the principle of the pupil-corneal reflection method is that a light source shines on the eye, and the image is captured by the image acquisition device. At the same time, the reflection point of the light source on the cornea, that is, a light spot, is obtained, thereby obtaining an eye image with a light spot.
  • the collected multiple eye images with light spots can reflect the position change relationship, and estimate the line of sight / fixation point according to the position change relationship.
  • a method that is not based on the eye image may also be used, such as estimating the eye movement based on a contact / non-contact sensor (eg, an electrode, a capacitance sensor).
  • a contact / non-contact sensor eg, an electrode, a capacitance sensor
  • FIG. 1 is a flowchart of an eye sight detection method provided in Embodiment 1 of the present application. This embodiment is applicable to a case where eye sight detection is performed.
  • the method may be performed by an eye sight detection device.
  • the device may be implemented by It is composed of hardware and / or software and can be integrated into VR glasses and all devices that include eye sight detection. As shown in FIG. 1, the method specifically includes the following steps.
  • Step 110 Obtain the sight line calibration coefficients of both eyes of the user under the monocular vision.
  • the sight line calibration coefficient includes a left eye sight line calibration coefficient and a right eye sight line calibration coefficient.
  • Monocular vision can be that only one eye can observe the outside world, and the other eye is in an unobservable state, such as being covered by an eye mask.
  • the monocular vision may be implemented by controlling the sight detection device to display nothing (black screen or solid color) in the visual field of one eye, and display the set visual stimulus element in the visual field of the other eye.
  • the way to obtain the sight line calibration coefficients of the user's eyes may be: in monocular vision, one or more set visual stimulus elements are displayed in the monocular field of view, and the point information of the visual stimulus elements is known. It is preset.
  • the eye tracking module collects the monocular eye image, analyzes the multiple monocular eye images, and obtains the eye characteristic parameter, namely the sight line calibration coefficient.
  • the calibration coefficients of the eyes of the user are obtained separately, which can be implemented in the following manner: in left-eye vision, the left-eye eyeball tracking module is used to calibrate the left eye to obtain the calibration coefficients of the left-eye vision; In right-eye vision, the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
  • left-eye vision may be to control the sight detection device to display nothing (black screen or solid color) in the field of view of the right eye, and display the set visual stimulus element in the field of view of the left eye.
  • one or more set visual stimulus elements are displayed in the left-eye field of view.
  • the left-eye eyeball tracking module collects the left-eye eye image, and Multiple left-eye eye images are analyzed to obtain left-eye characteristic parameters, that is, left-eye sight calibration coefficients.
  • the right-eye vision may be implemented by controlling the sight detection device to display nothing (black screen or solid color) in the visual field of the left eye, and display the set visual stimulus element in the visual field of the right eye.
  • one or more set visual stimulus elements are displayed in the right-eye field of view.
  • the right-eye eye tracking module collects the right-eye eye image, and Multiple right-eye eye images are analyzed to obtain right-eye characteristic parameters, that is, right-eye sight calibration coefficients.
  • Step 120 Under binocular vision, obtain binocular vision data of the user according to the left-eye and right-eye calibration coefficients.
  • the binocular sight data includes left-eye sight data and right-eye sight data.
  • Binocular vision can be the way that two eyes can observe the outside world at the same time, that is, the way a normal person usually observes the world.
  • the binocular vision may be implemented by controlling the visual field detection device to display the set visual stimulus elements simultaneously in the fields of vision of both eyes.
  • the line of sight data may include gaze point coordinates.
  • one or more set visual stimulus elements are displayed simultaneously in the binocular field of vision.
  • the left and right eye tracking modules simultaneously acquire eye images of both eyes.
  • the obtained binocular eye image is analyzed to obtain the line-of-sight data.
  • obtaining binocular vision data of the user according to the gaze calibration coefficient may be implemented in the following manner:
  • the set visual stimulus elements are displayed at different positions in the field of vision, and left-eye eye tracking
  • the module tracks the left eyeball, and obtains the left eye sight data based on the left eye sight calibration coefficient.
  • the right eye eyeball tracking module is used to track the right eye sight, and the right eye sight data is obtained based on the right eye sight calibration coefficient.
  • one or more set visual stimulus elements are displayed simultaneously in the binocular field of vision.
  • the left eye eyeball tracking module collects an eye image of the left eye, based on the left eye sight.
  • the calibration coefficient is used to analyze the acquired left-eye eye image to obtain left-line sight data.
  • the right-eye eyeball tracking module collects an eye image of the right eye, and analyzes the acquired right-eye eye image based on the right-eye sight calibration coefficient to obtain right-line sight data.
  • the method further includes the following steps: comparing the binocular vision data with the standard vision data to obtain a detection result.
  • the standard line-of-sight data is the direction of the line from the center of the pupil to the visual stimulus on the screen.
  • the eye tracking module can obtain the current position of the pupil center.
  • the eyeball is stimulated by the visual stimulus element to see the visual stimulus element. If there is no abnormality in the eyes, theoretically, the line of sight falls on the visual stimulus element, that is, the connection between the pupil center and the visual stimulus element is at this time.
  • the direction of the line of sight Therefore, the line of sight direction from the center of the eyeball to the visual stimulus on the screen is used as the standard line of sight data.
  • the left eye sight data is compared with the standard left eye sight data
  • the right eye sight data is compared with the standard right eye sight data to obtain a detection result.
  • the left-eye sight data is compared with the standard left-eye sight data
  • the right-eye sight data is compared with the standard right-eye sight data to obtain a detection result, which can be implemented in the following manner:
  • the detection result is that the user's eyes are normal
  • the detection result is that the user's left eye is abnormal
  • the detection result is that the user's right eye is abnormal
  • the detection result is that the user's eyes are abnormal.
  • eye abnormalities may include strabismus or amblyopia.
  • the eyesight calibration coefficients of the user's two eyes are respectively obtained in monocular vision, and then the binocular vision data of the user are obtained according to the eyesight calibration coefficient in the binocular vision.
  • the eye sight detection method provided in the embodiment of the present application can improve the accuracy of eye sight detection by detecting the eye sight of the user by using the eye tracking module.
  • FIG. 2 is a flowchart of another eye sight detection method provided in Embodiment 1 of the present application. As shown in FIG. 2, the method includes the following steps.
  • Step 210 In the left-eye vision, the left-eye eye tracking module is used to calibrate the left eye to obtain a left-eye sight calibration coefficient.
  • Step 220 Under the right-eye vision, the right-eye eye tracking module is used to calibrate the right eye to obtain a right-eye sight calibration coefficient.
  • Step 230 In binocular vision, display the set visual stimulus elements at different positions in the visual field, use the left eye tracking module to track the left eye, obtain left eye sight data based on the left eye sight calibration coefficient, and use the right eye sight The tracking module tracks the right eyeball, and obtains the right eye sight data based on the right eye sight calibration coefficient.
  • Step 240 Compare the left-eye sight data with the standard left-eye sight data, and compare the right-eye sight data with the standard right-eye sight data to obtain a detection result.
  • FIG. 3 is a schematic structural diagram of an eye sight detection device provided in Embodiment 2 of the present application. As shown in FIG. 3, the device includes a sight line calibration coefficient acquisition module 310 and a binocular sight line data acquisition module 320.
  • the line-of-sight calibration coefficient obtaining module 310 is configured to obtain the line-of-sight calibration coefficients of both eyes of the user under monocular vision, and the line-of-sight calibration coefficients include a left-eye line of sight calibration coefficient and a right-eye line of sight calibration coefficient;
  • the binocular sight data acquisition module 320 is configured to obtain binocular sight data of a user according to left eye and right eye sight calibration coefficients under binocular vision.
  • it further includes a detection result acquisition module configured to compare the binocular sight data with the standard sight data, respectively, to obtain a detection result.
  • a detection result acquisition module configured to compare the binocular sight data with the standard sight data, respectively, to obtain a detection result.
  • the line-of-sight calibration coefficient obtaining module 310 is further configured as:
  • the left-eye eyeball tracking module is used to calibrate the left eye to obtain the left-eye sight calibration coefficient
  • the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
  • the binocular sight data acquisition module 320 is further configured as:
  • the set visual stimulus elements are displayed at different positions in the field of vision.
  • the left eyeball tracking module is used to track the left eyeball, and the left eye sight data is obtained based on the left eye sight calibration coefficient;
  • the right eyeball tracking module was used to track the right eyeball, and the right eyeball data was obtained based on the right eyeball calibration coefficient.
  • the detection result acquisition module is further set to:
  • the left eye sight data is compared with the standard left eye sight data, and the right eye sight data is compared with the standard right eye sight data to obtain a detection result.
  • the detection result acquisition module is further set to:
  • the detection result is that the user's eyes are normal
  • the detection result is that the user's left eye is abnormal
  • the detection result is that the user's right eye is abnormal
  • the detection result is that the user's eyes are abnormal.
  • the above device can execute the methods provided by all the foregoing embodiments of the present application, and has corresponding functional modules and beneficial effects for performing the above methods.
  • the above device can execute the methods provided by all the foregoing embodiments of the present application, and has corresponding functional modules and beneficial effects for performing the above methods.
  • FIG. 4 is a schematic structural diagram of a mobile device provided in Embodiment 3 of the present application.
  • a mobile device provided in this embodiment includes a processor 41 and a memory 42.
  • the processor in the mobile device may be one or more.
  • a processor 41 is used as an example.
  • the processor 41 and the memory 42 in the mobile device may be connected through a bus or other methods. Take bus connection as an example.
  • the processor 41 of the mobile device in this embodiment integrates the eye sight detection device provided in the foregoing embodiment.
  • the memory 42 in the mobile device is used as a computer-readable storage medium, and may be used to store one or more programs.
  • the programs may be software programs, computer-executable programs, and modules, such as eyesight in the embodiments of the present application.
  • the detection method corresponds to the program instructions / modules.
  • the processor 41 runs software programs, instructions, and modules stored in the memory 42 to execute various functional applications and data processing of the device, that is, to implement the eye sight detection method in the foregoing method embodiment.
  • the memory 42 may include a storage program area and a storage data area, where the storage program area may store an operating system and application programs required for at least one function; the storage data area may store data created according to the use of the device, and the like.
  • the memory 42 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage device.
  • the memory 42 may further include a memory remotely disposed with respect to the processor 41, and these remote memories may be connected to the device through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • the processor 41 executes various functional applications and data processing by running a program stored in the memory 42 to implement the eye sight detection method provided by the embodiment of the present application.
  • the computer storage medium in the embodiment of the present application stores a computer program thereon, and when the program is executed by the data backup device, the eye sight detection method provided by the embodiment of the present application is implemented.
  • the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium.
  • the computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), Erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device.
  • the computer-readable signal medium may include a data signal propagated in baseband or transmitted as part of a carrier wave, which carries a computer-readable program code. Such a propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
  • Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
  • the computer program code for performing the operations of this application may be written in one or more programming languages, or a combination thereof, including programming languages such as Java, Smalltalk, C ++, and also conventional Procedural programming language—such as "C" or similar programming language.
  • the program code can be executed entirely on the user's computer, partly on the user's computer, as an independent software package, partly on the user's computer, partly on a remote computer, or entirely on a remote computer or server.
  • the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider) Internet connection).
  • LAN local area network
  • WAN wide area network
  • Internet service provider Internet service provider

Abstract

A line-of-sight detection method and device, an apparatus, and a storage medium. The method comprises: in monocular vision, obtaining line-of-sight calibration coefficients of both eyes of a user respectively (S110), wherein the line-of-sight calibration coefficients comprise a left-eye line-of-sight calibration coefficient and a right-eye line-of-sight calibration coefficient; and in binocular vision, obtaining line-of-sight data of both eyes of the user on the basis of the line-of-sight calibration coefficients (S120). In the detection method, an eye tracking module is used to detect the user's line of sight, thereby improving line-of-sight detection accuracy.

Description

眼睛视线的检测方法、装置、设备及存储介质Eye sight detection method, device, device and storage medium 技术领域Technical field
本申请实施例涉及视线检测技术领域，尤其涉及一种眼睛视线的检测方法、装置、设备及存储介质。The embodiments of the present application relate to the technical field of sight detection, and in particular, to a method, a device, a device, and a storage medium for detecting sight of an eye.
背景技术Background technique
因为每个人的眼睛具有不同的生理特征，所以即使视线在注视同一个方向时，其眼部的特征也是不同的。为了获取用户的视线方向，首先需要将具体用户的某些眼部特征与其视线方向之间的关系进行确定，这样，可以在后续的过程中，通过这种关系获知用户的视线方向。这种关系，我们称之为视线校准系数，也可以称之为视线标定参数。Because each person's eyes have different physiological characteristics, even when looking at the same direction, the characteristics of their eyes are different. In order to obtain the direction of the user's line of sight, the relationship between certain eye features of a specific user and the direction of the line of sight of the user needs to be determined first. In this way, the direction of the line of sight of the user can be obtained through this relationship in the subsequent process. This relationship is called the line-of-sight calibration coefficient, which can also be called the line-of-sight calibration parameter.
现有技术中，获取视线校准系数时，通常采用常规的手段进行，即在双眼视觉下，获取每只眼睛的校准系数。校准过程中，用户每只眼睛的视线虽然主观意图上是在对准校准所使用的视觉元素的位置，但由于用户可能存在的弱视、斜视等问题，客观上，每只眼睛的视线可能并没有真正对准校准所使用的视觉元素的位置。这样，利用常规手段所获取的校准系数所获得的视线方向数据，是用户主观意图观察的视线方向，而不是用户每只眼睛真实的视线方向。该方法获得了用户的主观视线方向，所以可以用于交互等功能。但是，有些时候我们希望获得用户真实的视线方向，例如，在对弱视或斜视患者进行诊断或康复训练的过程中，我们希望获得患者真实的视线数据，而不是主观的视线数据。在这种情况下，常规方法是不能获得准确视线数据的，本申请是为解决上述问 题而产生的。In the prior art, when obtaining the line-of-sight calibration coefficients, conventional methods are generally used, that is, in binocular vision, the calibration coefficients of each eye are obtained. During the calibration process, although the subjective intent of each eye of the user is to align the position of the visual elements used for calibration, due to the possible amblyopia and strabismus of the user, objectively, the sight of each eye may not be True alignment of the visual elements used for calibration. In this way, the line-of-sight direction data obtained by using the calibration coefficients obtained by conventional means is the line-of-sight direction of the user's subjective intention observation, rather than the true line-of-sight direction of each eye of the user. This method obtains the user's subjective line of sight, so it can be used for functions such as interaction. However, sometimes we want to obtain the user's true line of sight. For example, in the process of diagnosing or rehabilitating patients with amblyopia or strabismus, we want to obtain the true line of sight data of the patient, rather than the subjective line of sight data. In this case, the conventional method cannot obtain accurate sight data, and the present application was made to solve the above problems.
发明内容Summary of the invention
本申请实施例提供一种眼睛视线的检测方法、装置、设备及存储介质，可以提高对眼睛视线检测的准确性。The embodiments of the present application provide a method, a device, a device, and a storage medium for detecting the sight of an eye, which can improve the accuracy of detecting the sight of an eye.
第一方面，本申请实施例提供了一种眼睛视线的检测方法，该方法包括：In a first aspect, an embodiment of the present application provides a method for detecting eye gaze. The method includes:
在单眼视觉下，分别获取用户双眼的视线校准系数，所述视线校准系数包括左眼视线校准系数和右眼视线校准系数；Under monocular vision, obtaining the sight line calibration coefficients of both eyes of the user, the sight line calibration coefficients including a left eye sight line calibration coefficient and a right eye sight line calibration coefficient;
在双眼视觉下，根据所述视线校准系数获取用户的双眼视线数据；所述双眼视线数据包括左眼视线数据和右眼视线数据。In binocular vision, binocular vision data of a user is obtained according to the vision calibration coefficient; the binocular vision data includes left-eye vision data and right-eye vision data.
可选地，在在双眼视觉下，根据所述左眼和右眼视线校准系数获取用户的双眼视线数据之后，还包括，将所述双眼视线数据分别与标准视线数据进行比对，获得检测结果。Optionally, after obtaining the binocular vision data of the user according to the left-eye and right-eye vision calibration coefficients in binocular vision, the method further includes comparing the binocular vision data with the standard vision data to obtain a detection result. .
可选地，在单眼视觉下，分别获取用户双眼的视线校准系数，包括：Optionally, in monocular vision, obtaining the sight line calibration coefficients of both eyes of the user separately includes:
在左眼视觉下，采用左眼眼球追踪模块对左眼进行校准，获得左眼视线校准系数；In left-eye vision, the left-eye eyeball tracking module is used to calibrate the left eye to obtain the left-eye sight calibration coefficient;
在右眼视觉下，采用右眼眼球追踪模块对右眼进行校准，获得右眼视线校准系数。In right-eye vision, the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
可选地，在双眼视觉下，根据所述视线校准系数获取用户的双眼视线数据，包括：Optionally, in binocular vision, acquiring binocular vision data of a user according to the vision calibration coefficient includes:
在双眼视觉下，在视野的不同位置显示设定的视觉刺激元素，采用所述左眼眼球追踪模块对左眼眼球进行追踪，基于所述左眼视线校准系数获得左眼视 线数据；In binocular vision, the set visual stimulus elements are displayed at different positions of the visual field, the left eyeball tracking module is used to track the left eyeball, and the left eye sight data is obtained based on the left eye sight calibration coefficient;
采用所述右眼眼球追踪模块对右眼眼球进行追踪，基于所述右眼视线校准系数获得右眼视线数据。The right-eye eyeball tracking module is used to track the right-eye eyeball, and right-eye vision data is obtained based on the right-eye vision calibration coefficient.
可选地，将所述双眼视线数据分别与标准视线数据进行比对，获得检测结果，包括：Optionally, comparing the binocular sight data with standard sight data to obtain a detection result includes:
将所述左眼视线数据与标准左眼视线数据进行比对，且将所述右眼视线数据与标准右眼视线数据进行比对，获得检测结果。Compare the left eye sight data with standard left eye sight data, and compare the right eye sight data with standard right eye sight data to obtain a detection result.
可选地，将所述左眼视线数据与标准左眼视线数据进行比对，且将所述右眼视线数据与标准右眼视线数据进行比对，获得检测结果，包括：Optionally, comparing the left-eye sight data with standard left-eye sight data and comparing the right-eye sight data with standard right-eye sight data to obtain a detection result includes:
若所述左眼视线数据与标准左眼视线数据的偏差未超过设定阈值，且所述右眼视线数据与标准右眼视线数据的偏差未超过设定阈值，则检测结果为用户双眼正常；If the deviation between the left eye sight data and the standard left eye sight data does not exceed a set threshold, and the deviation between the right eye sight data and the standard right eye sight data does not exceed a set threshold, the detection result is that the user's eyes are normal;
若所述左眼视线数据与标准左眼视线数据的偏差超过设定阈值，且所述右眼视线数据与标准右眼视线数据的偏差未超过设定阈值，则检测结果为用户左眼异常；If the deviation between the left eye sight data and the standard left eye sight data exceeds a set threshold, and the deviation between the right eye sight data and the standard right eye sight data does not exceed the set threshold, the detection result is that the left eye of the user is abnormal;
若所述左眼视线数据与标准左眼视线数据的偏差未超过设定阈值，且所述右眼视线数据与标准右眼视线数据的偏差超过设定阈值，则检测结果为用户右眼异常；If the deviation between the left eye sight data and the standard left eye sight data does not exceed a set threshold, and the deviation between the right eye sight data and the standard right eye sight data exceeds a set threshold, the detection result is that the user's right eye is abnormal;
若所述左眼视线数据与标准左眼视线数据的偏差超过设定阈值，且所述右眼视线数据与标准右眼视线数据的偏差超过设定阈值，则检测结果为用户双眼异常。If the deviation between the left eye sight data and the standard left eye sight data exceeds a set threshold, and the deviation between the right eye sight data and the standard right eye sight data exceeds a set threshold, the detection result is that the user's eyes are abnormal.
第二方面，本申请实施例还提供了一种眼睛视线的检测装置，该装置包括：In a second aspect, an embodiment of the present application further provides an eye sight detection device, where the device includes:
视线校准系数获取模块，设置为在单眼视觉下，分别获取用户双眼的视线校准系数，所述视线校准系数包括左眼视线校准系数和右眼视线校准系数；The line-of-sight calibration coefficient acquisition module is configured to obtain the line-of-sight calibration coefficients of both eyes of the user under monocular vision, where the line-of-sight calibration coefficients include a left-eye line of sight calibration coefficient and a right-eye line of sight calibration coefficient;
双眼视线数据获取模块，设置为在双眼视觉下，根据所述视线校准系数获取用户的双眼视线数据；所述双眼视线数据包括左眼视线数据和右眼视线数据。The binocular sight data acquisition module is configured to obtain binocular sight data of a user according to the sight calibration coefficient under binocular vision; the binocular sight data includes left-eye sight data and right-eye sight data.
可选地，所述视线校准系数获取模块，还设置为：Optionally, the line-of-sight calibration coefficient acquisition module is further configured to:
在左眼视觉下，采用左眼眼球追踪模块对左眼进行校准，获得左眼视线校准系数；In left-eye vision, the left-eye eyeball tracking module is used to calibrate the left eye to obtain the left-eye sight calibration coefficient;
在右眼视觉下，采用右眼眼球追踪模块对右眼进行校准，获得右眼视线校准系数。In right-eye vision, the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
可选地，所述双眼视线数据获取模块，还设置为：Optionally, the binocular sight data acquisition module is further configured to:
在双眼视觉下，在视野的不同位置显示设定的视觉刺激元素，采用所述左眼眼球追踪模块对左眼眼球进行追踪，基于所述左眼视线校准系数获得左眼视线数据；In binocular vision, the set visual stimulus elements are displayed at different positions in the visual field, the left eyeball tracking module is used to track the left eyeball, and the left eyesight data is obtained based on the left eyesight calibration coefficient;
采用所述右眼眼球追踪模块对右眼眼球进行追踪，基于所述右眼视线校准系数获得右眼视线数据。The right-eye eyeball tracking module is used to track the right-eye eyeball, and right-eye vision data is obtained based on the right-eye vision calibration coefficient.
第三方面，本申请实施例还提供了一种移动设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现如本申请实施例所述的眼睛视线的检测方法。According to a third aspect, an embodiment of the present application further provides a mobile device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the implementation is implemented as in the present application. The method for detecting the sight of the eye according to the embodiment.
第四方面，本申请实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本申请实施例所述的眼睛视线的检测方法。According to a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the method for detecting an eye sight according to the embodiment of the present application is implemented.
本申请实施例，首先在单眼视觉下，分别获取用户双眼的视线校准系数， 然后在双眼视觉下，根据视线校准系数获取用户的双眼视线数据。本申请实施例提供的眼睛视线的检测方法，通过利用眼球追踪模块对用户的眼睛视线进行检测，可以提高眼睛视线检测的准确性。In the embodiment of the present application, firstly, the eyesight calibration coefficients of the user's two eyes are separately obtained in monocular vision, and then the binocular vision data of the user are obtained according to the eyesight calibration coefficient in the binocular vision. The eye sight detection method provided in the embodiment of the present application can improve the accuracy of eye sight detection by detecting the eye sight of the user by using the eye tracking module.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是本申请实施例一提供的一种眼睛视线的检测方法的流程图；FIG. 1 is a flowchart of an eye sight detection method provided in Embodiment 1 of the present application;
图2是本申请实施例一提供的另一种眼睛视线的检测方法的流程图；2 is a flowchart of another eye sight detection method provided in Embodiment 1 of the present application;
图3是本申请实施例二提供的一种眼睛视线的检测装置的结构示意图；3 is a schematic structural diagram of an eye sight detection device provided in Embodiment 2 of the present application;
图4是本申请实施例三提供的一种移动设备的结构示意图。FIG. 4 is a schematic structural diagram of a mobile device provided in Embodiment 3 of the present application.
具体实施方式detailed description
下面结合附图和实施例对本申请作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本申请，而非对本申请的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本申请相关的部分而非全部结构。The following describes the present application in detail with reference to the accompanying drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present application, rather than limiting the present application. It should also be noted that, for convenience of description, the drawings only show a part of the structure related to the present application, but not the entire structure.
实施例一Example one
眼球追踪也可以称为视线追踪，是通过测量眼睛运动情况来估计眼睛的视线和/或注视点的技术。其中，视线可以理解为一个三维矢量，注视点可以理解为三维矢量投影在某个平面上的二维坐标。Eye tracking can also be called gaze tracking, which is a technique that estimates eye sight and / or gaze point by measuring eye movements. Among them, the line of sight can be understood as a three-dimensional vector, and the fixation point can be understood as the two-dimensional coordinates of the three-dimensional vector projected on a certain plane.
本实施例中，对眼球进行追踪可以采用光学记录法实现。光学记录法的原理是，利用照相机或者摄像机记录被测试者的眼睛运动情况，即获取能够反映眼睛运动的眼部图像，从获取到的眼部图像中提取眼部特征用于建立视线/注视 点的估计模型。其中，眼部特征可以包括：瞳孔位置、瞳孔形状、虹膜位置、虹膜形状、眼皮位置、眼角位置、光斑位置(或者普尔钦斑)等。In this embodiment, the tracking of the eyeball can be implemented by an optical recording method. The principle of the optical recording method is to use a camera or a video camera to record the eye movement of the test subject, that is, to obtain an eye image that can reflect the eye movement, and extract eye features from the obtained eye image for establishing sight / fixation points. Estimation model. The eye features may include: pupil position, pupil shape, iris position, iris shape, eyelid position, eye corner position, light spot position (or Purchin spot), and the like.
光学记录法包括瞳孔-角膜反射法。瞳孔-角膜反射法的原理是，光源照向眼睛，由图像采集设备对眼部进行拍摄，同时拍摄到光源在角膜上的反射点即光斑，由此获取到带有光斑的眼部图像。Optical recording methods include pupil-corneal reflection method. The principle of the pupil-corneal reflection method is that a light source shines on the eye, and the image is captured by the image acquisition device. At the same time, the reflection point of the light source on the cornea, that is, a light spot, is obtained, thereby obtaining an eye image with a light spot.
随着眼球的转动，瞳孔中心与光斑的相对位置关系发生变化。采集到多张带有光斑的眼部图像都可以反映位置变化关系，根据位置变化关系进行视线/注视点的估计。With the rotation of the eyeball, the relative positional relationship between the pupil center and the spot changes. The collected multiple eye images with light spots can reflect the position change relationship, and estimate the line of sight / fixation point according to the position change relationship.
可选的，还可以采用不基于眼部图像的方法，例如基于接触/非接触式的传感器(例如电极、电容传感器)推算眼睛的运动。Alternatively, a method that is not based on the eye image may also be used, such as estimating the eye movement based on a contact / non-contact sensor (eg, an electrode, a capacitance sensor).
图1是本申请实施例一提供的一种眼睛视线的检测方法的流程图，本实施例可适用于对眼睛视线进行检测的情况，该方法可以由眼睛视线的检测装置来执行，该装置可由硬件和/或软件组成，并一般可集成在VR眼镜以及所有包含眼睛视线检测功能的设备中。如图1所示，该方法具体包括如下步骤。FIG. 1 is a flowchart of an eye sight detection method provided in Embodiment 1 of the present application. This embodiment is applicable to a case where eye sight detection is performed. The method may be performed by an eye sight detection device. The device may be implemented by It is composed of hardware and / or software and can be integrated into VR glasses and all devices that include eye sight detection. As shown in FIG. 1, the method specifically includes the following steps.
步骤110，在单眼视觉下，分别获取用户双眼的视线校准系数。Step 110: Obtain the sight line calibration coefficients of both eyes of the user under the monocular vision.
其中，视线校准系数包括左眼视线校准系数和右眼视线校准系数。单眼视觉可以是只有一只眼睛可以观察外部世界，另一只眼睛处于无法观察的状态，例如被眼罩遮住。本实施例中，单眼视觉的实现方式可以是，控制视线检测装置在一只眼睛的视野中无显示(黑屏或纯色)，在另一只眼睛的视野中显示设定的视觉刺激元素。The sight line calibration coefficient includes a left eye sight line calibration coefficient and a right eye sight line calibration coefficient. Monocular vision can be that only one eye can observe the outside world, and the other eye is in an unobservable state, such as being covered by an eye mask. In this embodiment, the monocular vision may be implemented by controlling the sight detection device to display nothing (black screen or solid color) in the visual field of one eye, and display the set visual stimulus element in the visual field of the other eye.
本应用场景下，获取用户眼睛的视线校准系数的方式可以是，在单眼视觉下，在单眼视野中显示一个或多个设定的视觉刺激元素，视觉刺激元素的点位 信息是已知的，是预先设定的，用户单眼注视设定的视觉刺激元素时，眼球追踪模块采集单眼眼部图像，对获取的多个单眼眼部图像进行分析，获得眼部特征参数，即视线校准系数。In this application scenario, the way to obtain the sight line calibration coefficients of the user's eyes may be: in monocular vision, one or more set visual stimulus elements are displayed in the monocular field of view, and the point information of the visual stimulus elements is known. It is preset. When the user looks at the set visual stimulus element with one eye, the eye tracking module collects the monocular eye image, analyzes the multiple monocular eye images, and obtains the eye characteristic parameter, namely the sight line calibration coefficient.
可选的，在单眼视觉下，分别获取用户双眼的视线校准系数，可通过下述方式实施：在左眼视觉下，采用左眼眼球追踪模块对左眼进行校准，获得左眼视线校准系数；在右眼视觉下，采用右眼眼球追踪模块对右眼进行校准，获得右眼视线校准系数。Optionally, in monocular vision, the calibration coefficients of the eyes of the user are obtained separately, which can be implemented in the following manner: in left-eye vision, the left-eye eyeball tracking module is used to calibrate the left eye to obtain the calibration coefficients of the left-eye vision; In right-eye vision, the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
其中，左眼视觉的实现方式可以是控制视线检测装置在右眼的视野中无显示(黑屏或纯色)，左眼的视野中显示设定的视觉刺激元素。在左眼视觉下，在左眼视野中显示一个或多个设定的视觉刺激元素，用户左眼注视设定的视觉刺激元素时，左眼眼球追踪模块采集左眼眼部图像，对获取的多个左眼眼部图像进行分析，获得左眼部特征参数，即左眼视线校准系数。The implementation of left-eye vision may be to control the sight detection device to display nothing (black screen or solid color) in the field of view of the right eye, and display the set visual stimulus element in the field of view of the left eye. In left-eye vision, one or more set visual stimulus elements are displayed in the left-eye field of view. When the user's left eye looks at the set visual stimulus elements, the left-eye eyeball tracking module collects the left-eye eye image, and Multiple left-eye eye images are analyzed to obtain left-eye characteristic parameters, that is, left-eye sight calibration coefficients.
其中，右眼视觉的实现方式可以是控制视线检测装置在左眼的视野中无显示(黑屏或纯色)，右眼的视野中显示设定的视觉刺激元素。在右眼视觉下，在右眼视野中显示一个或多个设定的视觉刺激元素，用户右眼注视设定的视觉刺激元素时，右眼眼球追踪模块采集右眼眼部图像，对获取的多个右眼眼部图像进行分析，获得右眼部特征参数，即右眼视线校准系数。The right-eye vision may be implemented by controlling the sight detection device to display nothing (black screen or solid color) in the visual field of the left eye, and display the set visual stimulus element in the visual field of the right eye. In right-eye vision, one or more set visual stimulus elements are displayed in the right-eye field of view. When the user's right eye looks at the set visual stimulus elements, the right-eye eye tracking module collects the right-eye eye image, and Multiple right-eye eye images are analyzed to obtain right-eye characteristic parameters, that is, right-eye sight calibration coefficients.
步骤120，在双眼视觉下，根据左眼和右眼视线校准系数获取用户的双眼视线数据。Step 120: Under binocular vision, obtain binocular vision data of the user according to the left-eye and right-eye calibration coefficients.
其中，双眼视线数据包括左眼视线数据和右眼视线数据。双眼视觉可以是两只眼睛可以同时观察外部世界，即正常人通常观察世界的方式。本实施例中，双眼视觉的实现方式可以是，控制视线检测装置两只眼睛的视野中同时显示设 定的视觉刺激元素。视线数据可以包括注视点坐标。The binocular sight data includes left-eye sight data and right-eye sight data. Binocular vision can be the way that two eyes can observe the outside world at the same time, that is, the way a normal person usually observes the world. In this embodiment, the binocular vision may be implemented by controlling the visual field detection device to display the set visual stimulus elements simultaneously in the fields of vision of both eyes. The line of sight data may include gaze point coordinates.
具体的，在双眼视觉下，在双眼视野中同时显示一个或多个设定的视觉刺激元素，用户双眼注视设定的视觉刺激元素时，左右眼眼球追踪模块同时采集两眼的眼部图像，基于视线校准系数，对获取的双眼眼眼部图像进行分析，获得双线视线数据。Specifically, in binocular vision, one or more set visual stimulus elements are displayed simultaneously in the binocular field of vision. When a user fixates on the set visual stimulus elements with both eyes, the left and right eye tracking modules simultaneously acquire eye images of both eyes. Based on the line-of-sight calibration coefficient, the obtained binocular eye image is analyzed to obtain the line-of-sight data.
可选的，在双眼视觉下，根据视线校准系数获取用户的双眼视线数据，可通过下述方式实施：在双眼视觉下，在视野的不同位置显示设定的视觉刺激元素，采用左眼眼球追踪模块对左眼眼球进行追踪，基于左眼视线校准系数获得左眼视线数据；采用右眼眼球追踪模块对右眼眼球进行追踪，基于右眼视线校准系数获得右眼视线数据。Optionally, in binocular vision, obtaining binocular vision data of the user according to the gaze calibration coefficient may be implemented in the following manner: In binocular vision, the set visual stimulus elements are displayed at different positions in the field of vision, and left-eye eye tracking The module tracks the left eyeball, and obtains the left eye sight data based on the left eye sight calibration coefficient. The right eye eyeball tracking module is used to track the right eye sight, and the right eye sight data is obtained based on the right eye sight calibration coefficient.
在双眼视觉下，在双眼视野中同时显示一个或多个设定的视觉刺激元素，用户双眼注视设定的视觉刺激元素时，左眼眼球追踪模块采集左眼的眼部图像，基于左眼视线校准系数，对获取的左眼眼眼部图像进行分析，获得左线视线数据。右眼眼球追踪模块采集右眼的眼部图像，基于右眼视线校准系数，对获取的右眼眼眼部图像进行分析，获得右线视线数据。In binocular vision, one or more set visual stimulus elements are displayed simultaneously in the binocular field of vision. When the user looks at the set visual stimulus elements with both eyes, the left eye eyeball tracking module collects an eye image of the left eye, based on the left eye sight. The calibration coefficient is used to analyze the acquired left-eye eye image to obtain left-line sight data. The right-eye eyeball tracking module collects an eye image of the right eye, and analyzes the acquired right-eye eye image based on the right-eye sight calibration coefficient to obtain right-line sight data.
可选的，在双眼视觉下，根据左眼和右眼视线校准系数获取用户的双眼视线数据之后，还包括如下步骤：将双眼视线数据分别与标准视线数据进行比对，获得检测结果。Optionally, in binocular vision, after obtaining the binocular vision data of the user according to the left-eye and right-eye vision calibration coefficients, the method further includes the following steps: comparing the binocular vision data with the standard vision data to obtain a detection result.
其中，标准视线数据是瞳孔中心到屏幕上视觉刺激元素的连线方向。眼球追踪模块可以获取到当前瞳孔中心所处的位置。当屏幕出现视觉刺激元素时，眼球受视觉刺激元素的刺激去看该视觉刺激元素，若眼睛无异常，理论上视线落在视觉刺激元素上，即瞳孔中心与视觉刺激元素的连线为此时的视线方向， 因而，将眼球中心到屏幕上视觉刺激元素的连线方向作为标准视线数据。具体的，在获得双眼视线数据后，将左眼视线数据与标准左眼视线数据进行比对，且将右眼视线数据与标准右眼视线数据进行比对，获得检测结果。The standard line-of-sight data is the direction of the line from the center of the pupil to the visual stimulus on the screen. The eye tracking module can obtain the current position of the pupil center. When a visual stimulus element appears on the screen, the eyeball is stimulated by the visual stimulus element to see the visual stimulus element. If there is no abnormality in the eyes, theoretically, the line of sight falls on the visual stimulus element, that is, the connection between the pupil center and the visual stimulus element is at this time. The direction of the line of sight. Therefore, the line of sight direction from the center of the eyeball to the visual stimulus on the screen is used as the standard line of sight data. Specifically, after obtaining the binocular sight data, the left eye sight data is compared with the standard left eye sight data, and the right eye sight data is compared with the standard right eye sight data to obtain a detection result.
可选的，将左眼视线数据与标准左眼视线数据进行比对，且将右眼视线数据与标准右眼视线数据进行比对，获得检测结果，可通过下述方式实施：Optionally, the left-eye sight data is compared with the standard left-eye sight data, and the right-eye sight data is compared with the standard right-eye sight data to obtain a detection result, which can be implemented in the following manner:
若左眼视线数据与标准左眼视线数据的偏差未超过设定阈值，且右眼视线数据与标准右眼视线数据的偏差未超过设定阈值，则检测结果为用户双眼正常；If the deviation between the left eye sight data and the standard left eye sight data does not exceed the set threshold, and the deviation between the right eye sight data and the standard right eye sight data does not exceed the set threshold, the detection result is that the user's eyes are normal;
若左眼视线数据与标准左眼视线数据的偏差超过设定阈值，且右眼视线数据与标准右眼视线数据的偏差未超过设定阈值，则检测结果为用户左眼异常；If the deviation between the left eye sight data and the standard left eye sight data exceeds a set threshold, and the deviation between the right eye sight data and the standard right eye sight data does not exceed the set threshold, the detection result is that the user's left eye is abnormal;
若左眼视线数据与标准左眼视线数据的偏差未超过设定阈值，且右眼视线数据与标准右眼视线数据的偏差超过设定阈值，则检测结果为用户右眼异常；If the deviation between the left eye sight data and the standard left eye sight data does not exceed the set threshold, and the deviation between the right eye sight data and the standard right eye sight data exceeds the set threshold, the detection result is that the user's right eye is abnormal;
若左眼视线数据与标准左眼视线数据的偏差超过设定阈值，且右眼视线数据与标准右眼视线数据的偏差超过设定阈值，则检测结果为用户双眼异常。If the deviation between the left eye sight data and the standard left eye sight data exceeds a set threshold, and the deviation between the right eye sight data and the standard right eye sight data exceeds a set threshold, the detection result is that the user's eyes are abnormal.
其中，眼睛异常可以包括眼睛斜视或弱视。Among them, eye abnormalities may include strabismus or amblyopia.
本实施例的技术方案，首先在单眼视觉下，分别获取用户双眼的视线校准系数，然后在双眼视觉下，根据视线校准系数获取用户的双眼视线数据。本申请实施例提供的眼睛视线的检测方法，通过利用眼球追踪模块对用户的眼睛视线进行检测，可以提高眼睛视线检测的准确性。In the technical solution of this embodiment, firstly, the eyesight calibration coefficients of the user's two eyes are respectively obtained in monocular vision, and then the binocular vision data of the user are obtained according to the eyesight calibration coefficient in the binocular vision. The eye sight detection method provided in the embodiment of the present application can improve the accuracy of eye sight detection by detecting the eye sight of the user by using the eye tracking module.
图2是本申请实施例一提供的另一种眼睛视线的检测方法的流程图。如图2所示，该方法包括如下步骤。FIG. 2 is a flowchart of another eye sight detection method provided in Embodiment 1 of the present application. As shown in FIG. 2, the method includes the following steps.
步骤210，在左眼视觉下，采用左眼眼球追踪模块对左眼进行校准，获得左眼视线校准系数。Step 210: In the left-eye vision, the left-eye eye tracking module is used to calibrate the left eye to obtain a left-eye sight calibration coefficient.
步骤220，在右眼视觉下，采用右眼眼球追踪模块对右眼进行校准，获得右眼视线校准系数。Step 220: Under the right-eye vision, the right-eye eye tracking module is used to calibrate the right eye to obtain a right-eye sight calibration coefficient.
步骤230，在双眼视觉下，在视野的不同位置显示设定的视觉刺激元素，采用左眼眼球追踪模块对左眼眼球进行追踪，基于左眼视线校准系数获得左眼视线数据，采用右眼眼球追踪模块对右眼眼球进行追踪，基于右眼视线校准系数获得右眼视线数据。Step 230: In binocular vision, display the set visual stimulus elements at different positions in the visual field, use the left eye tracking module to track the left eye, obtain left eye sight data based on the left eye sight calibration coefficient, and use the right eye sight The tracking module tracks the right eyeball, and obtains the right eye sight data based on the right eye sight calibration coefficient.
步骤240，将左眼视线数据与标准左眼视线数据进行比对，且将右眼视线数据与标准右眼视线数据进行比对，获得检测结果。Step 240: Compare the left-eye sight data with the standard left-eye sight data, and compare the right-eye sight data with the standard right-eye sight data to obtain a detection result.
实施例二Example two
图3是本申请实施例二提供的一种眼睛视线的检测装置的结构示意图。如图3所示，该装置包括：视线校准系数获取模块310，双眼视线数据获取模块320。FIG. 3 is a schematic structural diagram of an eye sight detection device provided in Embodiment 2 of the present application. As shown in FIG. 3, the device includes a sight line calibration coefficient acquisition module 310 and a binocular sight line data acquisition module 320.
视线校准系数获取模块310，设置为在单眼视觉下，分别获取用户双眼的视线校准系数，视线校准系数包括左眼视线校准系数和右眼视线校准系数；The line-of-sight calibration coefficient obtaining module 310 is configured to obtain the line-of-sight calibration coefficients of both eyes of the user under monocular vision, and the line-of-sight calibration coefficients include a left-eye line of sight calibration coefficient and a right-eye line of sight calibration coefficient;
双眼视线数据获取模块320，设置为在双眼视觉下，根据左眼和右眼视线校准系数获取用户的双眼视线数据。The binocular sight data acquisition module 320 is configured to obtain binocular sight data of a user according to left eye and right eye sight calibration coefficients under binocular vision.
可选的，还包括检测结果获取模块，设置为将双眼视线数据分别与标准视线数据进行比对，获得检测结果。Optionally, it further includes a detection result acquisition module configured to compare the binocular sight data with the standard sight data, respectively, to obtain a detection result.
可选的，视线校准系数获取模块310，还设置为：Optionally, the line-of-sight calibration coefficient obtaining module 310 is further configured as:
在左眼视觉下，采用左眼眼球追踪模块对左眼进行校准，获得左眼视线校准系数；In left-eye vision, the left-eye eyeball tracking module is used to calibrate the left eye to obtain the left-eye sight calibration coefficient;
在右眼视觉下，采用右眼眼球追踪模块对右眼进行校准，获得右眼视线校 准系数。In right-eye vision, the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
可选的，双眼视线数据获取模块320，还设置为：Optionally, the binocular sight data acquisition module 320 is further configured as:
在双眼视觉下，在视野的不同位置显示设定的视觉刺激元素，采用左眼眼球追踪模块对左眼眼球进行追踪，基于左眼视线校准系数获得左眼视线数据；In binocular vision, the set visual stimulus elements are displayed at different positions in the field of vision. The left eyeball tracking module is used to track the left eyeball, and the left eye sight data is obtained based on the left eye sight calibration coefficient;
采用右眼眼球追踪模块对右眼眼球进行追踪，基于右眼视线校准系数获得右眼视线数据。The right eyeball tracking module was used to track the right eyeball, and the right eyeball data was obtained based on the right eyeball calibration coefficient.
可选的，检测结果获取模块，还设置为：Optionally, the detection result acquisition module is further set to:
将左眼视线数据与标准左眼视线数据进行比对，且将右眼视线数据与标准右眼视线数据进行比对，获得检测结果。The left eye sight data is compared with the standard left eye sight data, and the right eye sight data is compared with the standard right eye sight data to obtain a detection result.
可选的，检测结果获取模块，还设置为：Optionally, the detection result acquisition module is further set to:
若左眼视线数据与标准左眼视线数据的偏差未超过设定阈值，且右眼视线数据与标准右眼视线数据的偏差未超过设定阈值，则检测结果为用户双眼正常；If the deviation between the left eye sight data and the standard left eye sight data does not exceed the set threshold, and the deviation between the right eye sight data and the standard right eye sight data does not exceed the set threshold, the detection result is that the user's eyes are normal;
若左眼视线数据与标准左眼视线数据的偏差超过设定阈值，且右眼视线数据与标准右眼视线数据的偏差未超过设定阈值，则检测结果为用户左眼异常；If the deviation between the left eye sight data and the standard left eye sight data exceeds a set threshold, and the deviation between the right eye sight data and the standard right eye sight data does not exceed the set threshold, the detection result is that the user's left eye is abnormal;
若左眼视线数据与标准左眼视线数据的偏差未超过设定阈值，且右眼视线数据与标准右眼视线数据的偏差超过设定阈值，则检测结果为用户右眼异常；If the deviation between the left eye sight data and the standard left eye sight data does not exceed the set threshold, and the deviation between the right eye sight data and the standard right eye sight data exceeds the set threshold, the detection result is that the user's right eye is abnormal;
若左眼视线数据与标准左眼视线数据的偏差超过设定阈值，且右眼视线数据与标准右眼视线数据的偏差超过设定阈值，则检测结果为用户双眼异常。If the deviation between the left eye sight data and the standard left eye sight data exceeds a set threshold, and the deviation between the right eye sight data and the standard right eye sight data exceeds a set threshold, the detection result is that the user's eyes are abnormal.
上述装置可执行本申请前述所有实施例所提供的方法，具备执行上述方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节，可参见本申请前述所有实施例所提供的方法。The above device can execute the methods provided by all the foregoing embodiments of the present application, and has corresponding functional modules and beneficial effects for performing the above methods. For technical details that are not described in detail in this embodiment, reference may be made to the methods provided in all the foregoing embodiments of the present application.
实施例三Example three
图4是本申请实施例三提供的一种移动设备的结构示意图，如图4所示，本实施例提供的一种移动设备，包括：处理器41和存储器42。该移动设备中的处理器可以是一个或多个，图4中以一个处理器41为例，所述移动设备中的处理器41和存储器42可以通过总线或其他方式连接，图4中以通过总线连接为例。FIG. 4 is a schematic structural diagram of a mobile device provided in Embodiment 3 of the present application. As shown in FIG. 4, a mobile device provided in this embodiment includes a processor 41 and a memory 42. The processor in the mobile device may be one or more. In FIG. 4, a processor 41 is used as an example. The processor 41 and the memory 42 in the mobile device may be connected through a bus or other methods. Take bus connection as an example.
本实施例中移动设备的处理器41中集成了上述实施例提供的眼睛视线的检测装置。此外，该移动设备中的存储器42作为一种计算机可读存储介质，可用于存储一个或多个程序，所述程序可以是软件程序、计算机可执行程序以及模块，如本申请实施例中眼睛视线的检测方法对应的程序指令/模块。处理器41通过运行存储在存储器42中的软件程序、指令以及模块，从而执行设备的各种功能应用以及数据处理，即实现上述方法实施例中眼睛视线的检测方法。The processor 41 of the mobile device in this embodiment integrates the eye sight detection device provided in the foregoing embodiment. In addition, the memory 42 in the mobile device is used as a computer-readable storage medium, and may be used to store one or more programs. The programs may be software programs, computer-executable programs, and modules, such as eyesight in the embodiments of the present application. The detection method corresponds to the program instructions / modules. The processor 41 runs software programs, instructions, and modules stored in the memory 42 to execute various functional applications and data processing of the device, that is, to implement the eye sight detection method in the foregoing method embodiment.
存储器42可包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序；存储数据区可存储根据设备的使用所创建的数据等。此外，存储器42可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中，存储器42可进一步包括相对于处理器41远程设置的存储器，这些远程存储器可以通过网络连接至设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 42 may include a storage program area and a storage data area, where the storage program area may store an operating system and application programs required for at least one function; the storage data area may store data created according to the use of the device, and the like. In addition, the memory 42 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some examples, the memory 42 may further include a memory remotely disposed with respect to the processor 41, and these remote memories may be connected to the device through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
处理器41通过运行存储在存储器42中的程序，从而执行各种功能应用以及数据处理，实现本申请实施例提供的眼睛视线的检测方法。The processor 41 executes various functional applications and data processing by running a program stored in the memory 42 to implement the eye sight detection method provided by the embodiment of the present application.
实施例四Example 4
本申请实施例的计算机存储介质，其上存储有计算机程序，该程序被数据 备份装置执行时实现如本申请实施例提供的眼睛视线的检测方法。The computer storage medium in the embodiment of the present application stores a computer program thereon, and when the program is executed by the data backup device, the eye sight detection method provided by the embodiment of the present application is implemented.
计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本文件中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), Erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing. In this document, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device.
计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。The computer-readable signal medium may include a data signal propagated in baseband or transmitted as part of a carrier wave, which carries a computer-readable program code. Such a propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括——但不限于无线、电线、光缆、RF等等，或者上述的任意合适的组合。Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
可以以一种或多种程序设计语言或其组合来编写用于执行本申请操作的计算机程序代码，所述程序设计语言包括面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如”C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算 机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。The computer program code for performing the operations of this application may be written in one or more programming languages, or a combination thereof, including programming languages such as Java, Smalltalk, C ++, and also conventional Procedural programming language—such as "C" or similar programming language. The program code can be executed entirely on the user's computer, partly on the user's computer, as an independent software package, partly on the user's computer, partly on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider) Internet connection).
注意，上述仅为本申请的较佳实施例及所运用技术原理。本领域技术人员会理解，本申请不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本申请的保护范围。因此，虽然通过以上实施例对本申请进行了较为详细的说明，但是本申请不仅仅限于以上实施例，在不脱离本申请构思的情况下，还可以包括更多其他等效实施例，而本申请的范围由所附的权利要求范围决定。Note that the above are only the preferred embodiments of this application and the technical principles applied. Those skilled in the art will understand that this application is not limited to the specific embodiments described herein, and that those skilled in the art can make various obvious changes, readjustments and substitutions without departing from the scope of protection of this application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments. Without departing from the concept of the present application, it may include more other equivalent embodiments, and the present application The scope is determined by the scope of the appended claims.

Claims (10)

  1. 一种眼睛视线的检测方法，包括：An eye sight detection method includes:
    在单眼视觉下，分别获取用户双眼的视线校准系数，所述视线校准系数包括左眼视线校准系数和右眼视线校准系数；Under monocular vision, obtaining the sight line calibration coefficients of both eyes of the user, the sight line calibration coefficients including a left eye sight line calibration coefficient and a right eye sight line calibration coefficient;
    在双眼视觉下，根据所述左眼和右眼视线校准系数获取用户的双眼视线数据；所述双眼视线数据包括左眼视线数据和右眼视线数据。In binocular vision, binocular vision data of a user is obtained according to the left-eye and right-eye calibration coefficients; the binocular vision data includes left-eye vision data and right-eye vision data.
  2. 根据权利要求1所述的方法，其中，在双眼视觉下，根据所述左眼和右眼视线校准系数获取用户的双眼视线数据之后，还包括：将所述双眼视线数据分别与标准视线数据进行比对，获得检测结果。The method according to claim 1, wherein, in binocular vision, after obtaining binocular vision data of a user according to the left-eye and right-eye vision calibration coefficients, further comprising: performing the binocular vision data with standard vision data, respectively. Compare and get test results.
  3. 根据权利要求1所述的方法，其中，在单眼视觉下，分别获取用户双眼的视线校准系数，包括：The method according to claim 1, wherein, in the monocular vision, obtaining the sight line calibration coefficients of the user's two eyes respectively comprises:
    在左眼视觉下，采用左眼眼球追踪模块对左眼进行校准，获得左眼视线校准系数；In left-eye vision, the left-eye eyeball tracking module is used to calibrate the left eye to obtain the left-eye sight calibration coefficient;
    在右眼视觉下，采用右眼眼球追踪模块对右眼进行校准，获得右眼视线校准系数。In right-eye vision, the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
  4. 根据权利要求3所述的方法，其中，在双眼视觉下，根据所述视线校准系数获取用户的双眼视线数据，包括：The method according to claim 3, wherein obtaining binocular sight data of a user according to the sight line calibration coefficient under binocular vision comprises:
    在双眼视觉下，在视野的不同位置显示设定的视觉刺激元素，采用所述左眼眼球追踪模块对左眼眼球进行追踪，基于所述左眼视线校准系数获得左眼视线数据；In binocular vision, the set visual stimulus elements are displayed at different positions in the visual field, the left eyeball tracking module is used to track the left eyeball, and the left eyesight data is obtained based on the left eyesight calibration coefficient;
    采用所述右眼眼球追踪模块对右眼眼球进行追踪，基于所述右眼视线校准系数获得右眼视线数据。The right-eye eyeball tracking module is used to track the right-eye eyeball, and right-eye vision data is obtained based on the right-eye vision calibration coefficient.
  5. 根据权利要求2所述的方法，其中，将所述双眼视线数据分别与标准 视线数据进行比对，获得检测结果，包括：The method according to claim 2, wherein comparing the binocular sight data with standard sight data, respectively, to obtain a detection result, comprising:
    将所述左眼视线数据与标准左眼视线数据进行比对，且将所述右眼视线数据与标准右眼视线数据进行比对，获得检测结果。Compare the left eye sight data with standard left eye sight data, and compare the right eye sight data with standard right eye sight data to obtain a detection result.
  6. 根据权利要求5所述的方法，其中，将所述左眼视线数据与标准左眼视线数据进行比对，且将所述右眼视线数据与标准右眼视线数据进行比对，获得检测结果，包括：The method according to claim 5, wherein the left eye sight data is compared with standard left eye sight data, and the right eye sight data is compared with standard right eye sight data to obtain a detection result, include:
    若所述左眼视线数据与标准左眼视线数据的偏差未超过设定阈值，且所述右眼视线数据与标准右眼视线数据的偏差未超过设定阈值，则检测结果为用户双眼正常；If the deviation between the left eye sight data and the standard left eye sight data does not exceed a set threshold, and the deviation between the right eye sight data and the standard right eye sight data does not exceed a set threshold, the detection result is that the user's eyes are normal;
    若所述左眼视线数据与标准左眼视线数据的偏差超过设定阈值，且所述右眼视线数据与标准右眼视线数据的偏差未超过设定阈值，则检测结果为用户左眼异常；If the deviation between the left eye sight data and the standard left eye sight data exceeds a set threshold, and the deviation between the right eye sight data and the standard right eye sight data does not exceed the set threshold, the detection result is that the left eye of the user is abnormal;
    若所述左眼视线数据与标准左眼视线数据的偏差未超过设定阈值，且所述右眼视线数据与标准右眼视线数据的偏差超过设定阈值，则检测结果为用户右眼异常；If the deviation between the left eye sight data and the standard left eye sight data does not exceed a set threshold, and the deviation between the right eye sight data and the standard right eye sight data exceeds a set threshold, the detection result is that the user's right eye is abnormal;
    若所述左眼视线数据与标准左眼视线数据的偏差超过设定阈值，且所述右眼视线数据与标准右眼视线数据的偏差超过设定阈值，则检测结果为用户双眼异常。If the deviation between the left eye sight data and the standard left eye sight data exceeds a set threshold, and the deviation between the right eye sight data and the standard right eye sight data exceeds a set threshold, the detection result is that the user's eyes are abnormal.
  7. 一种眼睛视线的检测装置，包括：An eye sight detection device includes:
    视线校准系数获取模块，设置为在单眼视觉下，分别获取用户双眼的视线校准系数，所述视线校准系数包括左眼视线校准系数和右眼视线校准系数；The line-of-sight calibration coefficient acquisition module is configured to obtain the line-of-sight calibration coefficients of both eyes of the user under monocular vision, where the line-of-sight calibration coefficients include a left-eye line-of-sight calibration coefficient and a right-eye line-of-sight calibration coefficient;
    双眼视线数据获取模块，设置为在双眼视觉下，根据所述左眼和右眼视线 校准系数获取用户的双眼视线数据；所述双眼视线数据包括左眼视线数据和右眼视线数据。The binocular sight data acquisition module is configured to obtain binocular sight data of a user according to the left-eye and right-eye sight calibration coefficients under binocular vision; the binocular sight data includes left-eye sight data and right-eye sight data.
  8. 根据权利要求7所述的装置，其中，所述视线校准系数获取模块，还设置为：The device according to claim 7, wherein the line-of-sight calibration coefficient acquisition module is further configured to:
    在左眼视觉下，采用左眼眼球追踪模块对左眼进行校准，获得左眼视线校准系数；In left-eye vision, the left-eye eyeball tracking module is used to calibrate the left eye to obtain the left-eye sight calibration coefficient;
    在右眼视觉下，采用右眼眼球追踪模块对右眼进行校准，获得右眼视线校准系数。In right-eye vision, the right-eye eye tracking module is used to calibrate the right eye to obtain the right-eye sight calibration coefficient.
  9. 一种移动设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现如权利要求1-6中任一所述的方法。A mobile device includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the method according to any one of claims 1-6 is implemented.
  10. 一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如权利要求1-6中任一所述的方法。A computer-readable storage medium having stored thereon a computer program that, when executed by a processor, implements the method according to any one of claims 1-6.
PCT/CN2019/078023 2018-07-13 2019-03-13 Line-of-sight detection method and device, apparatus, and storage medium WO2020010868A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810776796.8A CN109044263A (en) 2018-07-13 2018-07-13 Detection method, device, equipment and the storage medium of eye sight line
CN201810776796.8 2018-07-13

Publications (1)

Publication Number Publication Date
WO2020010868A1 true WO2020010868A1 (en) 2020-01-16

Family

ID=64816608

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/078023 WO2020010868A1 (en) 2018-07-13 2019-03-13 Line-of-sight detection method and device, apparatus, and storage medium

Country Status (2)

Country Link
CN (1) CN109044263A (en)
WO (1) WO2020010868A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109044263A (en) * 2018-07-13 2018-12-21 北京七鑫易维信息技术有限公司 Detection method, device, equipment and the storage medium of eye sight line
CN109558012B (en) * 2018-12-26 2022-05-13 北京七鑫易维信息技术有限公司 Eyeball tracking method and device
CN110399930B (en) * 2019-07-29 2021-09-03 北京七鑫易维信息技术有限公司 Data processing method and system
CN111290580B (en) * 2020-02-13 2022-05-31 Oppo广东移动通信有限公司 Calibration method based on sight tracking and related device
CN114569056B (en) * 2022-01-28 2022-11-15 首都医科大学附属北京天坛医院 Eyeball detection and vision simulation device and eyeball detection and vision simulation method

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7736000B2 (en) * 2008-08-27 2010-06-15 Locarna Systems, Inc. Method and apparatus for tracking eye movement
CN103654709A (en) * 2012-09-26 2014-03-26 瑞萨微系统有限公司 Line-of-sight detection apparatus, line-of-sight detection method, and program therefor
CN104834381A (en) * 2015-05-15 2015-08-12 中国科学院深圳先进技术研究院 Wearable device for sight focus positioning and sight focus positioning method
US20150309567A1 (en) * 2014-04-24 2015-10-29 Korea Institute Of Science And Technology Device and method for tracking gaze
CN106293100A (en) * 2016-08-24 2017-01-04 上海与德通讯技术有限公司 The determination method of sight line focus and virtual reality device in virtual reality device
US9857870B2 (en) * 2013-12-10 2018-01-02 Electronics And Telecommunications Research Institute Method of acquiring gaze information irrespective of whether user wears vision aid and moves
CN108259887A (en) * 2018-04-13 2018-07-06 宁夏大学 Watch point calibration method and device, blinkpunkt scaling method and device attentively
CN109044263A (en) * 2018-07-13 2018-12-21 北京七鑫易维信息技术有限公司 Detection method, device, equipment and the storage medium of eye sight line

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9463132B2 (en) * 2013-03-15 2016-10-11 John Castle Simmons Vision-based diagnosis and treatment
EP3129849B1 (en) * 2014-04-11 2020-02-12 Facebook Technologies, LLC Systems and methods of eye tracking calibration
US9727136B2 (en) * 2014-05-19 2017-08-08 Microsoft Technology Licensing, Llc Gaze detection calibration
CN106659380B (en) * 2014-06-12 2019-03-12 Sr实验室有限公司 Calibrate the device and method of eye tracker and the eyes control device including calibrator (-ter) unit
NL2016085B1 (en) * 2016-01-13 2017-07-24 Stichting Vu-Vumc Method, system and computer readable medium to determine a strabismus angle between the eyes of an individual.
CN107007248A (en) * 2017-04-17 2017-08-04 广州视景医疗软件有限公司 A kind of strabismus screening method, server and system based on artificial intelligence

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7736000B2 (en) * 2008-08-27 2010-06-15 Locarna Systems, Inc. Method and apparatus for tracking eye movement
CN103654709A (en) * 2012-09-26 2014-03-26 瑞萨微系统有限公司 Line-of-sight detection apparatus, line-of-sight detection method, and program therefor
US9857870B2 (en) * 2013-12-10 2018-01-02 Electronics And Telecommunications Research Institute Method of acquiring gaze information irrespective of whether user wears vision aid and moves
US20150309567A1 (en) * 2014-04-24 2015-10-29 Korea Institute Of Science And Technology Device and method for tracking gaze
CN104834381A (en) * 2015-05-15 2015-08-12 中国科学院深圳先进技术研究院 Wearable device for sight focus positioning and sight focus positioning method
CN106293100A (en) * 2016-08-24 2017-01-04 上海与德通讯技术有限公司 The determination method of sight line focus and virtual reality device in virtual reality device
CN108259887A (en) * 2018-04-13 2018-07-06 宁夏大学 Watch point calibration method and device, blinkpunkt scaling method and device attentively
CN109044263A (en) * 2018-07-13 2018-12-21 北京七鑫易维信息技术有限公司 Detection method, device, equipment and the storage medium of eye sight line

Also Published As

Publication number Publication date
CN109044263A (en) 2018-12-21

Similar Documents

Publication Publication Date Title
WO2020010868A1 (en) Line-of-sight detection method and device, apparatus, and storage medium
US11786117B2 (en) Mobile device application for ocular misalignment measurement
US10413177B2 (en) Eyeball observation device, eyewear terminal, line-of-sight detection method, and program
US20190235624A1 (en) Systems and methods for predictive visual rendering
JP6340503B2 (en) Eye tracking system and method for detecting dominant eye
US9775512B1 (en) Binocular eye tracking from video frame sequences
US9398848B2 (en) Eye gaze tracking
US10564716B2 (en) 3D gazing point detection by binocular homography mapping
Hosp et al. RemoteEye: An open-source high-speed remote eye tracker: Implementation insights of a pupil-and glint-detection algorithm for high-speed remote eye tracking
US11612316B2 (en) Medical system and method operable to control sensor-based wearable devices for examining eyes
KR20150140814A (en) Head and eye tracking
KR102099223B1 (en) System and method for diagnosing for strabismus, aparratus for acquiring gaze image, computer program
JP2018196730A (en) Method and system for monitoring eye position
Kowsari et al. Multi-depth cross-calibration of remote eye gaze trackers and stereoscopic scene systems
Sangi et al. An optokinetic nystagmus detection method for use with young children
Dunn Required accuracy of gaze tracking for varifocal displays
KR101526557B1 (en) Apparatus and method for gaze tracking based on multiple camera
US11526987B2 (en) Image processing method, program, and image processing device
US20170332947A1 (en) System and methods for diplopia assessment
JP6496917B2 (en) Gaze measurement apparatus and gaze measurement method
JP2015123262A (en) Sight line measurement method using corneal surface reflection image, and device for the same
Jaiseeli et al. SLKOF: Subsampled Lucas-Kanade Optical Flow for Opto Kinetic Nystagmus detection
US20220211267A1 (en) Device navigation and capture of media data
US20240049963A1 (en) Cover-Uncover Test in a VR/AR Headset
US20230363637A1 (en) Remote subjective refraction techniques

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19834840

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 30/04/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19834840

Country of ref document: EP

Kind code of ref document: A1