WO2019237772A1 - Light source control method and apparatus - Google Patents

Light source control method and apparatus Download PDF

Info

Publication number
WO2019237772A1
WO2019237772A1 PCT/CN2019/077213 CN2019077213W WO2019237772A1 WO 2019237772 A1 WO2019237772 A1 WO 2019237772A1 CN 2019077213 W CN2019077213 W CN 2019077213W WO 2019237772 A1 WO2019237772 A1 WO 2019237772A1
Authority
WO
WIPO (PCT)
Prior art keywords
light source
image acquisition
acquisition system
eye
image
Prior art date
Application number
PCT/CN2019/077213
Other languages
French (fr)
Chinese (zh)
Inventor
姜欣
付阳
王云飞
黄通兵
Original Assignee
北京七鑫易维信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京七鑫易维信息技术有限公司 filed Critical 北京七鑫易维信息技术有限公司
Publication of WO2019237772A1 publication Critical patent/WO2019237772A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Definitions

  • the present application relates to the field of image processing, and in particular, to a light source control method and device.
  • Eye tracking technology refers to a technique for obtaining a user's gaze point by analyzing a user's eye movement.
  • the mainstream technology mainly relies on the eye image based on the infrared frequency band to analyze the eye feature information, and then to obtain the user's gaze point.
  • a light spot can be formed by reflecting light on the cornea in the infrared frequency band, and combining the spot position and eye feature information in the eye image to determine the user's gaze point, but when the eye is closer to the image acquisition device, the light spot is easily lost , Resulting in inaccurate gaze point estimation.
  • the embodiments of the present application provide a light source control method and device to solve the problem of inaccurate gaze point estimation in the prior art when the eye is closer to the image acquisition device.
  • the eye image is obtained by shooting an eye of the target object through an image acquisition system, and the first light spot is the light generated by the first light source reflected by the cornea in the eye to Formed in the image acquisition system;
  • the second light source is separate from the first light source Located on both sides of the image acquisition system, and / or, the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system.
  • the first light source includes at least one infrared light source
  • the second light source includes at least one infrared light source
  • the first light source includes a first infrared light source and a second infrared light source, and the first infrared light source and the second infrared light source are respectively disposed on two sides of the image acquisition system;
  • the second light source includes a third infrared light source and a fourth infrared light source, and the third infrared light source and the fourth infrared light source are respectively disposed on two sides of the image acquisition system.
  • the image acquisition system includes at least two image acquisition devices; the eye image is obtained by photographing the eyes of the target object through a first image acquisition device, wherein a focal length of the first image acquisition device is less than or equal to The focal lengths of other image acquisition devices except the first image acquisition device in the image acquisition system are described.
  • the method further includes:
  • a judging unit configured to judge whether a first light spot exists in an eye image; the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is light generated by a first light source passing through the eyes The cornea formed by reflection in the image acquisition system;
  • the second light source turning-on unit is configured to turn on the second light source if the judgment result of the judging unit is no, so that light generated by the second light source is reflected by the cornea in the eye to the image acquisition system to form a second Light spot; the second light source and the first light source are located on both sides of the image acquisition system, and / or, the distance between the second light source and the image acquisition system is smaller than the first light source and the The distance of the image acquisition system.
  • the first light source includes at least one infrared light source
  • the second light source includes at least one infrared light source
  • the first light source includes a first infrared light source and a second infrared light source, and the first infrared light source and the second infrared light source are respectively disposed on two sides of the image acquisition system;
  • the second light source includes a third infrared light source and a fourth infrared light source, and the third infrared light source and the fourth infrared light source are respectively disposed on two sides of the image acquisition system.
  • the image acquisition system includes at least two image acquisition devices; the eye image is obtained by photographing the eyes of the target object through a first image acquisition device, wherein a focal length of the first image acquisition device is less than or equal to The focal lengths of other image acquisition devices except the first image acquisition device in the image acquisition system are described.
  • the device further includes:
  • the first light source turning-on unit is configured to determine a distance between the target object and the image acquisition device according to a feature of the eye image. If the distance is greater than or equal to a preset length, the first light source is in an off state. , The first light source is turned on.
  • the light source control method and device determine whether a first light spot exists in an eye image, where the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is a first light source The generated light is reflected by the cornea in the eye to the image acquisition system. If it is determined that the first spot does not exist in the eye image, the second light source can be turned on so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition.
  • a second light spot is formed in the system, wherein the second light source and the first light source are respectively located on two sides of the image acquisition system, and / or the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system.
  • the missing light spot in the eye image is usually caused by the eye being closer to the image acquisition system, the light generated by the first light source cannot be reflected by the cornea in the eye, or cannot enter the image acquisition system normally after the corneal reflection in the eye. Therefore, when the first light spot does not exist in the eye image, the second light source is turned on, because the second light source is closer to the image acquisition system, and / or, the second light source and the first light source are located on both sides of the image acquisition system, respectively, Enable the light generated by the second light source to enter the image acquisition system through the corneal reflection in the eye smoothly, thereby forming a second light spot in the eye image, so as to calculate the fixation point according to the second light spot and eye characteristics, and improve the calculation of the fixation point accuracy.
  • FIG. 1 is a schematic diagram of forming a first light spot according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of a first light spot loss according to an embodiment of the present application.
  • FIG. 3 is a flowchart of a light source control method according to an embodiment of the present application.
  • FIG. 4 is a schematic diagram of forming a second light spot according to an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of a light source and an image acquisition system according to an embodiment of the present application.
  • FIG. 6 is a structural block diagram of a light source control device according to an embodiment of the present application.
  • FIG. 1 is a schematic diagram of the formation of a first light spot provided by an embodiment of the present application.
  • the first light source 101 generates infrared light, forms a reflection point 103 on the cornea 102, and enters the image acquisition system 104 to cause the image acquisition system 104 to shoot.
  • the gaze point of the user may be determined according to the position of the first light spot and the characteristic information of the eyes, where the characteristic information of the eyes may be, for example, the position of the pupil center 106 of the eyes.
  • FIG. 2 is a schematic diagram of a first light spot loss provided by an embodiment of the present application.
  • the first light source 101 when the eye is close to the image acquisition device, the first light source 101 generates infrared light, and a reflection point 103 is formed on the cornea 102 to reflect the light.
  • the direction of the incident light and the direction of the incident light are related to the curvature center 105 of the cornea 102.
  • the reflection angle ⁇ is the line between the curvature center 105 and the reflection point 103 (the virtual line shown in the figure) and the first The included angle of the reflected light (the thick solid line shown in the figure) corresponding to the light source 101 cannot reflect the light smoothly into the image acquisition device, so the eye image captured by the image acquisition device does not include the first light spot, that is, the first light spot is lost.
  • the direction of the user's line of sight deviates from the setting position of the first light source 101, the light generated by the first light source 101 cannot irradiate the cornea 102 in the eye, and no reflected light can be generated, resulting in the loss of the first light spot.
  • the estimation of the user's gaze point based on the eye image without the first spot is not accurate.
  • embodiments of the present application provide a light source control method and device, which determine whether a first light spot exists in an eye image, where the eye image is obtained by shooting an eye of a target object through an image acquisition system.
  • a light spot is formed by the light generated by the first light source reflecting through the cornea in the eye to the image acquisition system. If it is determined that the first light spot does not exist in the eye image, the second light source can be turned on so that the light generated by the second light source passes through the eye.
  • the cornea is reflected into the image acquisition system to form a second light spot, wherein the second light source and the first light source are respectively located on both sides of the image acquisition system, and / or the distance between the second light source and the image acquisition system is smaller than the first light source and the image acquisition system The distance of the system. Because the missing light spot in the eye image is usually caused by the eye being closer to the image acquisition system, the light generated by the first light source cannot be reflected by the cornea in the eye, or cannot enter the image acquisition system normally after the corneal reflection in the eye.
  • the second light source when the first light spot does not exist in the eye image, the second light source is turned on, because the second light source is closer to the image acquisition system, and / or, the second light source and the first light source are located on both sides of the image acquisition system, respectively, Enable the light generated by the second light source to pass through the corneal reflection in the eye and enter the image acquisition system, thereby forming a second light spot in the eye image, so as to calculate the fixation point according to the second light spot and eye characteristics, and improve the calculation of the fixation point accuracy.
  • FIG. 3 is a flowchart of a light source control method according to an embodiment of the present application. As shown in FIG. 3, the method includes the following steps.
  • the eye image is obtained by photographing the eyes of the target object through an image acquisition system.
  • the image acquisition system may include at least one image acquisition device, and the image acquisition device may be an infrared camera, an infrared camera, etc. When irradiated, the image acquisition device can acquire light information in the infrared frequency band.
  • a first light spot may exist in the eye image.
  • the first light source 101 generates infrared light
  • the reflection point 103 on the cornea 102 reflects into the image acquisition system 104, so that the eye image obtained by the image acquisition system 104 is captured.
  • the first light source 101 includes at least one infrared light source, such as an infrared light emitting diode, an infrared laser with a lower power, or other light sources that can generate infrared light, and is used to illuminate the face and eyes of a target object. Infrared light It can be reflected by the cornea 102 into the image acquisition system 104, so that a first light spot is formed in the eye image captured by the image acquisition system.
  • infrared light source such as an infrared light emitting diode, an infrared laser with a lower power, or other light sources that can generate infrared light
  • the reflection angle ⁇ of the light generated by the first light source 101 on the cornea 102 is large, and the light corresponding to the first light source 101 is reflected by the cornea 102 and cannot enter the image acquisition system.
  • the first light spot does not exist in the eye image captured by the system 104, and S102 may be performed at this time.
  • FIG. 4 is a schematic diagram of forming a second light spot according to an embodiment of the present application.
  • the second light source 107 and the first light source 101 may be on the same side of the image acquisition system 104.
  • the distance between the two light sources 107 and the image acquisition system 104 may be smaller than the distance between the first light source 101 and the image acquisition system.
  • the second light source 107 includes at least one infrared light source, such as an infrared light emitting diode, an infrared laser with a lower power, or other light sources that can generate infrared light, and is used to illuminate the face and eyes of a target object to make an image
  • the acquisition system 104 can capture the eyes of the target object and the light spot formed by the infrared light reflected on the cornea, and obtain characteristic information of the eyes of the target object.
  • the infrared light generated by the second light source 107 is reflected on the reflection point 103 relative to the reflection angle ⁇ of the infrared light generated by the first light source 101 at the reflection point 103.
  • the reflection angle ⁇ is small, where the reflection angle ⁇ is the angle between the line between the center of curvature 105 and the reflection point 103 (thin dashed line in the figure) and the reflected light (thick dashed line in the figure) corresponding to the second light source 107.
  • the light corresponding to the two light sources 107 is reflected by the cornea 102 and can enter the image acquisition system 104, so that the image acquisition system 104 has a second light spot in the eye image captured when the second light source 107 illuminates the target object's eyes.
  • the position of the second spot and the feature information of the eyes estimate the gaze point of the target object.
  • the second light source 107 and the first light source 101 may also be respectively located on two sides of the image acquisition system 104 (not shown in the figure). Specifically, a plane passing through the image acquisition system 104 and perpendicular to the line where the first light source 101 and the image acquisition system are located can be constructed. The plane divides the space into two sides of the image acquisition system 104, and the first light source 101 can be located in the image acquisition. The first side of the system 104 and the second light source 107 may be located on the second side of the image acquisition system 104.
  • the first light spot is usually lost when the target object is closer to the image acquisition system 104 and the sight of the target object falls at a point away from the setting position of the first light source 101, the cornea 102 in the target object's eyes.
  • the line of sight deviates from the setting position of the first light source 101, the light generated by the first light source 101 on the first side of the image acquisition system 104 cannot directly irradiate the cornea 102 in the eyes of the target object, so there is no reflection Light appears in the image acquisition system 104, causing the first spot to be lost.
  • the cornea 102 in the target's eyes is deviated with the direction of the line of sight
  • the setting position of the second light source 107 The light generated by the second light source 107 can directly irradiate the cornea 102 in the eyes of the target object and enter the image acquisition system 104 through reflection. At this time, a second light spot appears in the eye image, which is convenient.
  • the calculation of the fixation point is performed according to the second light spot and the characteristics of the eye, thereby improving the accuracy of the fixation point calculation.
  • the distance between the second light source 107 and the image acquisition system 104 may be smaller than the distance between the first light source 101 and the image acquisition system 104.
  • the light from the two light sources 107 can be directly irradiated on the cornea 102 in the eyes of the target object, and the reflection angle is small, which is convenient for a second light spot to appear in the eye image.
  • the distance between the second light source 107 and the image acquisition system 104 may also be greater than or equal to the distance between the first light source 101 and the image acquisition system 104.
  • the cornea 102 in the eye of the target object is deviated to the setting position of the second light source 107 with the line of sight.
  • the light generated by the second light source 107 can directly irradiate the cornea 102 in the eye of the target object and enter the image acquisition system 104 through reflection. A second flare appears in the eye image.
  • FIG. 5 is a schematic structural diagram of a light source and an image acquisition system according to an embodiment of the present application.
  • the image acquisition system 104 may include a first image acquisition device 1041 and a second image acquisition device 1042.
  • the eye image can be obtained by photographing the eyes of the target object by the first image acquisition device 1041, and the focal length of the first image acquisition device 1041 is less than or equal to other image acquisition devices in the image acquisition system 104 except the first image acquisition device 1041 ,
  • the focal length of the first image acquisition device 1041 is smaller than or equal to the focal length of the second image acquisition device 1042.
  • the first light source 101 may include a first infrared light source 1011 and a second infrared light source 1012.
  • the first infrared light source 1011 and the second infrared light source 1012 are respectively disposed on two sides of the image acquisition system 104.
  • the second light source 107 may include The third infrared light source 1071 and the fourth infrared light source 1072, and the third infrared light source 1071 and the fourth infrared light source 1072 are respectively disposed on two sides of the image acquisition system 104.
  • the first infrared light source 1011 and the second infrared light source 1012 may work at the same time, or only one of them may work.
  • the third infrared light source 1071 and the fourth infrared light source 1072 may work simultaneously. Work, or only one of them.
  • the second light source 107 is turned on, the first light source 101 may be turned off, or the first light source 101 may not be turned off.
  • the third infrared light source 1071 on the same side as the first infrared light source 1011 may be turned on, or the fourth infrared light source on the different side from the first infrared light source 1011 may be turned on.
  • Light source 1072 wherein the distance between the fourth infrared light source 1072 and the first image acquisition device 1041 may be smaller than the distance between the first infrared light source 1011 and the first image acquisition device 1041, or may be greater than or equal to the first infrared light source 1011 and the first image The distance of the acquisition device 1041; when the first light spot formed by the second infrared light source 1012 reflected by the cornea 102 is lost, the fourth infrared light source 1072 on the same side as the second infrared light source 1012 can be turned on, or the second infrared light source 1012 can be turned on The third infrared light source 1071 on a different side, wherein the distance between the third infrared light source 1071 and the first image acquisition device 1041 may be smaller than the distance between the second infrared light source 1012 and the first image acquisition device 1041, or may be greater than or equal to the second infrared The distance between the light source 1012 and the first image acquisition device 1041.
  • the distance between the target object and the image acquisition system may also be determined according to the characteristics of the eye image. Specifically, the distance between the target object and the image acquisition system may be determined by the pupil diameter in the eye image. The distance between the target object and the image acquisition system can also be determined by the distance between the pupils in the eye image, and can also be determined by the characteristics of other eye images, and no examples are given here.
  • the pupil diameter is less than or equal to the preset diameter, it means that the distance between the target object and the image acquisition system is far, and at this time, it can be determined that the distance between the target object and the image acquisition system is greater than or equal to the preset length.
  • the distance between the pupils is less than or equal to a preset distance, it can be determined that the distance between the target object and the image acquisition system is greater than or equal to a preset length.
  • the first light source 101 When the distance between the target object and the image acquisition system is greater than or equal to the preset length, if the first light source 101 is turned off, the first light source 101 may be turned on.
  • An embodiment of the present application provides a method for controlling a light source, by determining whether a first light spot exists in an eye image, where the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is generated by the first light source The light is formed by reflecting the cornea in the eye into the image acquisition system. If it is determined that there is no first light spot in the eye image, the second light source can be turned on so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition system.
  • a second light spot is formed, wherein the second light source and the first light source are respectively located on two sides of the image acquisition system, and / or the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system. Because the missing light spot in the eye image is usually caused by the eye being closer to the image acquisition system, the light generated by the first light source cannot be reflected by the cornea in the eye, or cannot enter the image acquisition system normally after the corneal reflection in the eye.
  • the second light source when the first light spot does not exist in the eye image, the second light source is turned on, because the second light source is closer to the image acquisition system, and / or, the second light source and the first light source are located on both sides of the image acquisition system, respectively, Enable the light generated by the second light source to pass through the corneal reflection in the eye and enter the image acquisition system, thereby forming a second light spot in the eye image, so as to calculate the fixation point according to the second light spot and eye characteristics, and improve the calculation of the fixation point accuracy.
  • the embodiment of the present application further provides a light source control device.
  • the working principle is described in detail below with reference to the accompanying drawings.
  • FIG. 6 is a structural block diagram of a light source control device according to an embodiment of the present application. As shown in FIG. 6, the device includes:
  • the determining unit 110 is configured to determine whether a first light spot exists in an eye image; the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is light generated by a first light source through the light source. Formed by the cornea in the eye reflecting into the image acquisition system;
  • the second light source turning-on unit 120 is configured to turn on the second light source if the determination result of the determining unit is no, so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition system to form a first Two light spots; the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system.
  • the first light source includes at least one infrared light source
  • the second light source includes at least one infrared light source
  • the first light source includes a first infrared light source and a second infrared light source, and the first infrared light source and the second infrared light source are respectively disposed on two sides of the image acquisition system;
  • the second light source includes a third infrared light source and a fourth infrared light source, and the third infrared light source and the fourth infrared light source are respectively disposed on two sides of the image acquisition system.
  • the image acquisition system includes at least two image acquisition devices; the eye image is obtained by photographing the eyes of the target object through a first image acquisition device, wherein a focal length of the first image acquisition device is less than or equal to The focal lengths of other image acquisition devices except the first image acquisition device in the image acquisition system are described.
  • the device further includes:
  • the first light source turning-on unit is configured to determine a distance between the target object and the image acquisition device according to a feature of the eye image. If the distance is greater than or equal to a preset length, the first light source is in an off state. , The first light source is turned on.
  • An embodiment of the present application provides a light source control device, which determines whether a first light spot exists in an eye image, where the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is generated by the first light source The light is formed by reflecting the cornea in the eye into the image acquisition system. If it is determined that there is no first light spot in the eye image, the second light source can be turned on so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition system. A second light spot is formed, wherein the second light source and the first light source are respectively located on two sides of the image acquisition system, and / or the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system.
  • the missing light spot in the eye image is usually caused by the eye being closer to the image acquisition system, the light generated by the first light source cannot be reflected by the cornea in the eye, or cannot enter the image acquisition system normally after the corneal reflection in the eye. Therefore, when the first light spot does not exist in the eye image, the second light source is turned on, because the second light source is closer to the image acquisition system, and / or, the second light source and the first light source are located on both sides of the image acquisition system, respectively, Enable the light generated by the second light source to pass through the corneal reflection in the eye and enter the image acquisition system, thereby forming a second light spot in the eye image, so as to calculate the fixation point according to the second light spot and eye characteristics, and improve the calculation of the fixation point accuracy.
  • the program can be stored in a computer-readable storage In the medium, when the program is executed, it may include the processes of the foregoing method embodiments.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

Embodiments of the present application disclose a light source control method and apparatus. Whether a first light spot exists in an eye image is determined, the eye image being obtained by photographing an eye of a target object by an image collection system, and the first light spot being formed by reflecting light generated by a first light source into the image collection system by the cornea in the eye; and if it is determined that the first light spot does not exist in the eye image, a second light source can be turned on, so that light generated by the second light source is reflected by the cornea in the eye into the image collection system to form a second light spot, the second light source and the first light source being respectively located on two sides of the image collection system, and/or, the distance between the second light source and the image collection system is less than the distance between the first light source and the image collection system. The light generated by the second light source can be reflected by the cornea into the image collection system to form the second light spot in the eye image, so that the calculation of a fixation point is performed according to the second light spot and eye features, thereby improving the calculation accuracy of the fixation point.

Description

一种光源控制方法及装置Method and device for controlling light source 技术领域Technical field
本申请涉及图像处理领域,尤其涉及一种光源控制方法及装置。The present application relates to the field of image processing, and in particular, to a light source control method and device.
背景技术Background technique
眼球追踪技术是指通过分析用户眼部运动得到用户注视点的技术。主流技术主要依靠基于红外频段的眼睛图像,分析眼睛特征信息,进而得出用户注视点。Eye tracking technology refers to a technique for obtaining a user's gaze point by analyzing a user's eye movement. The mainstream technology mainly relies on the eye image based on the infrared frequency band to analyze the eye feature information, and then to obtain the user's gaze point.
现有技术中,可以通过红外频段的光在角膜上反射形成光斑,结合眼睛图像中的光斑位置和眼睛特征信息来确定用户注视点,但是在眼睛距离图像采集设备较近时,很容易丢失光斑,导致注视点估算不准确。In the prior art, a light spot can be formed by reflecting light on the cornea in the infrared frequency band, and combining the spot position and eye feature information in the eye image to determine the user's gaze point, but when the eye is closer to the image acquisition device, the light spot is easily lost , Resulting in inaccurate gaze point estimation.
发明内容Summary of the Invention
本申请实施例提供了一种光源控制方法及装置,以解决现有技术中在眼睛距离图像采集设备较近时,注视点估算不准确的问题。The embodiments of the present application provide a light source control method and device to solve the problem of inaccurate gaze point estimation in the prior art when the eye is closer to the image acquisition device.
本申请实施例提供的一种光源控制方法,包括:A light source control method provided in an embodiment of the present application includes:
判断眼睛图像中是否存在第一光斑;所述眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,所述第一光斑为第一光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成的;Determine whether there is a first light spot in the eye image; the eye image is obtained by shooting an eye of the target object through an image acquisition system, and the first light spot is the light generated by the first light source reflected by the cornea in the eye to Formed in the image acquisition system;
若否,则开启第二光源,以便所述第二光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成第二光斑;所述第二光源与所述第一光源分别位于所述图像采集系统的两侧,和/或,所述第二光源与所述图像采集系统的距离小于所述第一光源与所述图像采集系统的距离。If not, turn on the second light source, so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition system to form a second light spot; the second light source is separate from the first light source Located on both sides of the image acquisition system, and / or, the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system.
可选的,所述第一光源包括至少一个红外光源,所述第二光源包括至少一个红外光源。Optionally, the first light source includes at least one infrared light source, and the second light source includes at least one infrared light source.
可选的,所述第一光源包括第一红外光源和第二红外光源,所述第一红外光源和所述第二红外光源分别设置于所述图像采集系统的两侧;Optionally, the first light source includes a first infrared light source and a second infrared light source, and the first infrared light source and the second infrared light source are respectively disposed on two sides of the image acquisition system;
所述第二光源包括第三红外光源和第四红外光源,所述第三红外光源和所述第四红外光源分别设置于所述图像采集系统的两侧。The second light source includes a third infrared light source and a fourth infrared light source, and the third infrared light source and the fourth infrared light source are respectively disposed on two sides of the image acquisition system.
可选的,所述图像采集系统包括至少两个图像采集设备;所述眼睛图像通过第一图像采集设备对目标对象的眼睛进行拍摄得到,其中所述第一图像采集设备的焦距小于或等于所述图像采集系统中除第一图像采集设备的其他图像采集设备的焦距。Optionally, the image acquisition system includes at least two image acquisition devices; the eye image is obtained by photographing the eyes of the target object through a first image acquisition device, wherein a focal length of the first image acquisition device is less than or equal to The focal lengths of other image acquisition devices except the first image acquisition device in the image acquisition system are described.
可选的,所述方法还包括:Optionally, the method further includes:
根据所述眼睛图像的特征确定所述目标对象与所述图像采集设备之间的距离,若所述距离大于或等于预设长度,所述第一光源处于关闭状态,则开启所述第一光源。Determine the distance between the target object and the image acquisition device according to the characteristics of the eye image, and if the distance is greater than or equal to a preset length, and the first light source is turned off, the first light source is turned on .
本申请实施例提供的一种光源控制装置,包括:A light source control device provided in an embodiment of the present application includes:
判断单元,设置为判断眼睛图像中是否存在第一光斑;所述眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,所述第一光斑为第一光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成的;A judging unit configured to judge whether a first light spot exists in an eye image; the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is light generated by a first light source passing through the eyes The cornea formed by reflection in the image acquisition system;
第二光源开启单元,设置为若判断单元的判断结果为否,则开启第二光源,以便所述第二光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成第二光斑;所述第二光源与所述第一光源分别位于所述图像采集系统的两侧,和/或,所述第二光源与所述图像采集系统的距离小于所述第一光源与所述图像采集系统的距离。The second light source turning-on unit is configured to turn on the second light source if the judgment result of the judging unit is no, so that light generated by the second light source is reflected by the cornea in the eye to the image acquisition system to form a second Light spot; the second light source and the first light source are located on both sides of the image acquisition system, and / or, the distance between the second light source and the image acquisition system is smaller than the first light source and the The distance of the image acquisition system.
可选的,所述第一光源包括至少一个红外光源,所述第二光源包括至少一个红外光源。Optionally, the first light source includes at least one infrared light source, and the second light source includes at least one infrared light source.
可选的,所述第一光源包括第一红外光源和第二红外光源,所述第一红外光源和所述第二红外光源分别设置于所述图像采集系统的两侧;Optionally, the first light source includes a first infrared light source and a second infrared light source, and the first infrared light source and the second infrared light source are respectively disposed on two sides of the image acquisition system;
所述第二光源包括第三红外光源和第四红外光源,所述第三红外光源和所述第四红外光源分别设置于所述图像采集系统的两侧。The second light source includes a third infrared light source and a fourth infrared light source, and the third infrared light source and the fourth infrared light source are respectively disposed on two sides of the image acquisition system.
可选的,所述图像采集系统包括至少两个图像采集设备;所述眼睛图像通过第一图像采集设备对目标对象的眼睛进行拍摄得到,其中所述第一图像采集设备的焦距小于或等于所述图像采集系统中除第一图像采集设备 的其他图像采集设备的焦距。Optionally, the image acquisition system includes at least two image acquisition devices; the eye image is obtained by photographing the eyes of the target object through a first image acquisition device, wherein a focal length of the first image acquisition device is less than or equal to The focal lengths of other image acquisition devices except the first image acquisition device in the image acquisition system are described.
可选的,所述装置还包括:Optionally, the device further includes:
第一光源开启单元,设置为根据所述眼睛图像的特征确定所述目标对象与所述图像采集设备之间的距离,若所述距离大于或等于预设长度,所述第一光源处于关闭状态,则开启所述第一光源。The first light source turning-on unit is configured to determine a distance between the target object and the image acquisition device according to a feature of the eye image. If the distance is greater than or equal to a preset length, the first light source is in an off state. , The first light source is turned on.
本申请实施例提供的一种光源控制方法及装置,通过判断眼睛图像中是否存在第一光斑,其中眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,第一光斑为第一光源产生的光经眼睛中的角膜反射到图像采集系统中形成的,若判断眼睛图像中不存在第一光斑,可以开启第二光源,以便第二光源产生的光经眼睛中的角膜反射到图像采集系统中形成第二光斑,其中第二光源与第一光源分别位于图像采集系统的两侧,和/或,第二光源与图像采集系统的距离小于第一光源与图像采集系统的距离。由于眼睛图像中丢失光斑通常是由于眼睛距离图像采集系统较近所致,此时第一光源产生的光不能经眼睛中的角膜反射,或经眼睛中的角膜反射后不能正常进入图像采集系统中,因此在眼睛图像中不存在第一光斑时,开启第二光源,由于第二光源与图像采集系统的距离较近,和/或,第二光源与第一光源分别位于图像采集系统的两侧,使第二光源产生的光能够通过顺利眼睛中的角膜反射进入图像采集系统中,从而在眼睛图像中形成第二光斑,以便根据第二光斑和眼睛特征进行注视点的计算,提高注视点计算的准确性。The light source control method and device provided in the embodiments of the present application determine whether a first light spot exists in an eye image, where the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is a first light source The generated light is reflected by the cornea in the eye to the image acquisition system. If it is determined that the first spot does not exist in the eye image, the second light source can be turned on so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition. A second light spot is formed in the system, wherein the second light source and the first light source are respectively located on two sides of the image acquisition system, and / or the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system. Because the missing light spot in the eye image is usually caused by the eye being closer to the image acquisition system, the light generated by the first light source cannot be reflected by the cornea in the eye, or cannot enter the image acquisition system normally after the corneal reflection in the eye. Therefore, when the first light spot does not exist in the eye image, the second light source is turned on, because the second light source is closer to the image acquisition system, and / or, the second light source and the first light source are located on both sides of the image acquisition system, respectively, Enable the light generated by the second light source to enter the image acquisition system through the corneal reflection in the eye smoothly, thereby forming a second light spot in the eye image, so as to calculate the fixation point according to the second light spot and eye characteristics, and improve the calculation of the fixation point accuracy.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请中记载的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。In order to explain the technical solutions in the embodiments of the present application or the prior art more clearly, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are merely These are some of the embodiments described in this application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without paying creative labor.
图1为本申请实施例提供的第一光斑形成示意图;FIG. 1 is a schematic diagram of forming a first light spot according to an embodiment of the present application; FIG.
图2为本申请实施例提供的第一光斑丢失示意图;FIG. 2 is a schematic diagram of a first light spot loss according to an embodiment of the present application; FIG.
图3为本申请实施例提供的一种光源控制方法的流程图;3 is a flowchart of a light source control method according to an embodiment of the present application;
图4为本申请实施例提供的第二光斑形成示意图;4 is a schematic diagram of forming a second light spot according to an embodiment of the present application;
图5为本申请实施例提供的光源和图像采集系统的结构示意图;5 is a schematic structural diagram of a light source and an image acquisition system according to an embodiment of the present application;
图6为本申请实施例提供的一种光源控制装置的结构框图。FIG. 6 is a structural block diagram of a light source control device according to an embodiment of the present application.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only These are part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
本申请的发明人经过研究发现,现有技术中,通过红外频段的光在角膜上反射进入图像采集设备中,使图像采集设备对眼睛进行拍摄得到的眼睛图像中包括光斑,结合光斑位置和眼睛的特征信息可以确定用户注视点。图1为本申请实施例提供的第一光斑形成示意图,如图1所示,第一光源101产生红外光,在角膜102上形成反射点103进入图像采集系统104中,使图像采集系统104拍摄得到的眼睛图像中存在第一光斑,第一光斑在眼睛图像中的位置可参考反射点103在角膜102上的位置。根据第一光斑的位置和眼睛的特征信息可确定用户注视点,其中,眼睛的特征信息例如可以是眼睛的瞳孔中心106的位置。The inventor of the present application has found through research that in the prior art, light in the infrared frequency band is reflected on the cornea and entered into an image acquisition device, and the eye image obtained by the image acquisition device photographing the eye includes a light spot, combining the position of the light spot and the eye The feature information can determine the user's gaze point. FIG. 1 is a schematic diagram of the formation of a first light spot provided by an embodiment of the present application. As shown in FIG. 1, the first light source 101 generates infrared light, forms a reflection point 103 on the cornea 102, and enters the image acquisition system 104 to cause the image acquisition system 104 to shoot. A first light spot exists in the obtained eye image, and the position of the first light spot in the eye image can refer to the position of the reflection point 103 on the cornea 102. The gaze point of the user may be determined according to the position of the first light spot and the characteristic information of the eyes, where the characteristic information of the eyes may be, for example, the position of the pupil center 106 of the eyes.
图2为本申请实施例提供的第一光斑丢失示意图,如图2所示,在眼睛距离图像采集设备较近时,第一光源101产生红外光,在角膜102上形成反射点103,反射光的方向和入射光的方向与角膜102的曲率中心105相关,此时,由于反射角α较大,其中反射角α为曲率中心105和反射点103的连线(图示虚直线)与第一光源101对应的反射光(图示粗实直线)的夹角,反射光不能顺利进入图像采集设备中,因此图像采集设备拍摄到的眼睛图像中不包括第一光斑,即第一光斑丢失。在用户的视线方向偏离第一光源101的设置位置时,第一光源101产生的光不能照射在眼睛中的角膜102上,不能产生反射光,导致丢失第一光斑。根据没有第一光斑的 眼睛图像对用户的注视点进行估算的准确性不高。FIG. 2 is a schematic diagram of a first light spot loss provided by an embodiment of the present application. As shown in FIG. 2, when the eye is close to the image acquisition device, the first light source 101 generates infrared light, and a reflection point 103 is formed on the cornea 102 to reflect the light. The direction of the incident light and the direction of the incident light are related to the curvature center 105 of the cornea 102. At this time, because the reflection angle α is large, the reflection angle α is the line between the curvature center 105 and the reflection point 103 (the virtual line shown in the figure) and the first The included angle of the reflected light (the thick solid line shown in the figure) corresponding to the light source 101 cannot reflect the light smoothly into the image acquisition device, so the eye image captured by the image acquisition device does not include the first light spot, that is, the first light spot is lost. When the direction of the user's line of sight deviates from the setting position of the first light source 101, the light generated by the first light source 101 cannot irradiate the cornea 102 in the eye, and no reflected light can be generated, resulting in the loss of the first light spot. The estimation of the user's gaze point based on the eye image without the first spot is not accurate.
为了解决上述技术问题,本申请实施例提供了一种光源控制方法及装置,通过判断眼睛图像中是否存在第一光斑,其中眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,第一光斑为第一光源产生的光经眼睛中的角膜反射到图像采集系统中形成的,若判断眼睛图像中不存在第一光斑,可以开启第二光源,以便第二光源产生的光经眼睛中的角膜反射到图像采集系统中形成第二光斑,其中第二光源与第一光源分别位于图像采集系统的两侧,和/或,第二光源与图像采集系统的距离小于第一光源与图像采集系统的距离。由于眼睛图像中丢失光斑通常是由于眼睛距离图像采集系统较近所致,此时第一光源产生的光不能经眼睛中的角膜反射,或经眼睛中的角膜反射后不能正常进入图像采集系统中,因此在眼睛图像中不存在第一光斑时,开启第二光源,由于第二光源与图像采集系统的距离较近,和/或,第二光源与第一光源分别位于图像采集系统的两侧,使第二光源产生的光能够顺利通过眼睛中的角膜反射进入图像采集系统中,从而在眼睛图像中形成第二光斑,以便根据第二光斑和眼睛特征进行注视点的计算,提高注视点计算的准确性。In order to solve the foregoing technical problems, embodiments of the present application provide a light source control method and device, which determine whether a first light spot exists in an eye image, where the eye image is obtained by shooting an eye of a target object through an image acquisition system. A light spot is formed by the light generated by the first light source reflecting through the cornea in the eye to the image acquisition system. If it is determined that the first light spot does not exist in the eye image, the second light source can be turned on so that the light generated by the second light source passes through the eye. Of the cornea is reflected into the image acquisition system to form a second light spot, wherein the second light source and the first light source are respectively located on both sides of the image acquisition system, and / or the distance between the second light source and the image acquisition system is smaller than the first light source and the image acquisition system The distance of the system. Because the missing light spot in the eye image is usually caused by the eye being closer to the image acquisition system, the light generated by the first light source cannot be reflected by the cornea in the eye, or cannot enter the image acquisition system normally after the corneal reflection in the eye. Therefore, when the first light spot does not exist in the eye image, the second light source is turned on, because the second light source is closer to the image acquisition system, and / or, the second light source and the first light source are located on both sides of the image acquisition system, respectively, Enable the light generated by the second light source to pass through the corneal reflection in the eye and enter the image acquisition system, thereby forming a second light spot in the eye image, so as to calculate the fixation point according to the second light spot and eye characteristics, and improve the calculation of the fixation point accuracy.
下面结合附图,详细说明本申请的各种非限制性实施方式。Various non-limiting embodiments of the present application will be described in detail below with reference to the drawings.
图3为本申请实施例提供的一种光源控制方法的流程图,如图3所示,该方法包括以下步骤。FIG. 3 is a flowchart of a light source control method according to an embodiment of the present application. As shown in FIG. 3, the method includes the following steps.
S101,判断眼睛图像中是否存在第一光斑,若否,执行S102。S101. Determine whether a first light spot exists in the eye image, and if not, perform S102.
眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,图像采集系统可以包括至少一个图像采集设备,图像采集设备可以是红外照相机、红外摄像机等,在目标对象的眼睛被红外频段的光照射时,图像采集设备可以获取红外频段的光信息。The eye image is obtained by photographing the eyes of the target object through an image acquisition system. The image acquisition system may include at least one image acquisition device, and the image acquisition device may be an infrared camera, an infrared camera, etc. When irradiated, the image acquisition device can acquire light information in the infrared frequency band.
在眼睛图像中可以存在第一光斑,参考图1所示,第一光源101产生红外光,在角膜102上的反射点103反射进入图像采集系统104中,使图像采集系统104拍摄得到的眼睛图像中存在第一光斑,也就是说,在眼睛图像中,反射点103对应的位置为亮点,即为第一光斑。A first light spot may exist in the eye image. As shown in FIG. 1, the first light source 101 generates infrared light, and the reflection point 103 on the cornea 102 reflects into the image acquisition system 104, so that the eye image obtained by the image acquisition system 104 is captured. There is a first light spot in the image, that is, in the eye image, the position corresponding to the reflection point 103 is a bright spot, that is, the first light spot.
第一光源101包括至少一个红外光源,例如可以是红外发光二极管, 也可以是功率较小的红外激光器,还可以是其他可以产生红外光的光源,用于照射目标对象的面部及眼睛,红外光可以经角膜102反射进入图像采集系统104中,使图像采集系统拍摄到的眼睛图像中形成有第一光斑。The first light source 101 includes at least one infrared light source, such as an infrared light emitting diode, an infrared laser with a lower power, or other light sources that can generate infrared light, and is used to illuminate the face and eyes of a target object. Infrared light It can be reflected by the cornea 102 into the image acquisition system 104, so that a first light spot is formed in the eye image captured by the image acquisition system.
在眼睛距离图像采集系统较近时,第一光源101产生的光在角膜102处的反射角α较大,第一光源101对应的光经角膜102反射,不能进入到图像采集系统中,图像采集系统104拍摄到的眼睛图像中不存在第一光斑,此时可执行S102。When the eye is closer to the image acquisition system, the reflection angle α of the light generated by the first light source 101 on the cornea 102 is large, and the light corresponding to the first light source 101 is reflected by the cornea 102 and cannot enter the image acquisition system. The first light spot does not exist in the eye image captured by the system 104, and S102 may be performed at this time.
S102,开启第二光源,以形成第二光斑。S102. Turn on the second light source to form a second light spot.
作为一种可选的实施方式,图4为本申请实施例提供的第二光斑形成示意图,如图4所示,第二光源107可以与第一光源101在图像采集系统104的同一侧,第二光源107与图像采集系统104的距离可以小于第一光源101与图像采集系统的距离。As an optional implementation manner, FIG. 4 is a schematic diagram of forming a second light spot according to an embodiment of the present application. As shown in FIG. 4, the second light source 107 and the first light source 101 may be on the same side of the image acquisition system 104. The distance between the two light sources 107 and the image acquisition system 104 may be smaller than the distance between the first light source 101 and the image acquisition system.
第二光源107包括至少一个红外光源,例如可以是红外发光二极管,也可以是功率较小的红外激光器,还可以是其他可以产生红外光的光源,用于照射目标对象的面部及眼睛,使图像采集系统104能够拍摄到目标对象的眼睛以及上述红外光在角膜上反射形成的光斑,获取到目标对象的眼睛的特征信息。The second light source 107 includes at least one infrared light source, such as an infrared light emitting diode, an infrared laser with a lower power, or other light sources that can generate infrared light, and is used to illuminate the face and eyes of a target object to make an image The acquisition system 104 can capture the eyes of the target object and the light spot formed by the infrared light reflected on the cornea, and obtain characteristic information of the eyes of the target object.
由于第二光源107与图像采集系统104的距离更近,相对于第一光源101产生的红外光在反射点103反射的反射角α,第二光源107产生的红外光在反射点103上反射的反射角β较小,其中反射角β为曲率中心105和反射点103的连线(图示细虚直线)与第二光源107对应的反射光(图示粗虚直线)的夹角,因此第二光源107对应的光经角膜102反射,可以进入到图像采集系统104中,使图像采集系统104在第二光源107照射目标对象的眼睛时拍摄到的眼睛图像中存在第二光斑,进而可以根据第二光斑的位置和眼睛的特征信息估算目标对象的注视点。Since the second light source 107 is closer to the image acquisition system 104, the infrared light generated by the second light source 107 is reflected on the reflection point 103 relative to the reflection angle α of the infrared light generated by the first light source 101 at the reflection point 103. The reflection angle β is small, where the reflection angle β is the angle between the line between the center of curvature 105 and the reflection point 103 (thin dashed line in the figure) and the reflected light (thick dashed line in the figure) corresponding to the second light source 107. The light corresponding to the two light sources 107 is reflected by the cornea 102 and can enter the image acquisition system 104, so that the image acquisition system 104 has a second light spot in the eye image captured when the second light source 107 illuminates the target object's eyes. The position of the second spot and the feature information of the eyes estimate the gaze point of the target object.
此外,作为另一种可选的实施方式,第二光源107与第一光源101也可以分别位于图像采集系统104的两侧(图未示出)。具体来说,可以构建经过图像采集系统104且垂直于第一光源101和图像采集系统所在的直线的平面,该平面将空间分为图像采集系统104的两侧,第一光源101可以 位于图像采集系统104的第一侧,第二光源107可以位于图像采集系统104的第二侧。In addition, as another optional implementation manner, the second light source 107 and the first light source 101 may also be respectively located on two sides of the image acquisition system 104 (not shown in the figure). Specifically, a plane passing through the image acquisition system 104 and perpendicular to the line where the first light source 101 and the image acquisition system are located can be constructed. The plane divides the space into two sides of the image acquisition system 104, and the first light source 101 can be located in the image acquisition. The first side of the system 104 and the second light source 107 may be located on the second side of the image acquisition system 104.
一般来说,第一光斑丢失的情况,通常是目标对象距离图像采集系统104较近,且目标对象的视线落在远离第一光源101的设置位置的点时,目标对象的眼睛中的角膜102随着视线方向偏离第一光源101的设置位置,位于图像采集系统104的第一侧的第一光源101产生的光不能直接照射在目标对象的眼睛中的角膜102上,因此,不会有反射光出现在图像采集系统104中,造成第一光斑丢失。若开启设置与图像采集系统104的第二侧的第二光源107,由于第二光源107与第一光源101位于图像采集系统的两侧,则目标对象的眼睛中的角膜102随着视线方向偏向第二光源107的设置位置,第二光源107产生的光可以直接照射在目标对象的眼睛中的角膜102上,通过反射进入图像采集系统104中,此时,眼睛图像中出现第二光斑,便于根据第二光斑和眼睛特征进行注视点的计算,提高注视点计算的准确性。In general, the first light spot is usually lost when the target object is closer to the image acquisition system 104 and the sight of the target object falls at a point away from the setting position of the first light source 101, the cornea 102 in the target object's eyes. As the line of sight deviates from the setting position of the first light source 101, the light generated by the first light source 101 on the first side of the image acquisition system 104 cannot directly irradiate the cornea 102 in the eyes of the target object, so there is no reflection Light appears in the image acquisition system 104, causing the first spot to be lost. If the second light source 107 provided on the second side of the image acquisition system 104 is turned on, since the second light source 107 and the first light source 101 are located on both sides of the image acquisition system, the cornea 102 in the target's eyes is deviated with the direction of the line of sight The setting position of the second light source 107. The light generated by the second light source 107 can directly irradiate the cornea 102 in the eyes of the target object and enter the image acquisition system 104 through reflection. At this time, a second light spot appears in the eye image, which is convenient. The calculation of the fixation point is performed according to the second light spot and the characteristics of the eye, thereby improving the accuracy of the fixation point calculation.
其中,第二光源107和第一光源101分别位于图像采集系统104的两侧时,第二光源107与图像采集系统104的距离可以小于第一光源101与图像采集系统104的距离,此时第二光源107的光可以直接照射在目标对象的眼睛中的角膜102上,且反射角较小,便于在眼睛图像中出现第二光斑。When the second light source 107 and the first light source 101 are located on both sides of the image acquisition system 104, the distance between the second light source 107 and the image acquisition system 104 may be smaller than the distance between the first light source 101 and the image acquisition system 104. The light from the two light sources 107 can be directly irradiated on the cornea 102 in the eyes of the target object, and the reflection angle is small, which is convenient for a second light spot to appear in the eye image.
第二光源107和第一光源101分别位于图像采集系统104的两侧时,第二光源107与图像采集系统104的距离也可以大于或等于第一光源101与图像采集系统104的距离,此时目标对象的眼睛中的角膜102随着视线方向偏向第二光源107的设置位置,第二光源107产生的光可以直接照射在目标对象的眼睛中的角膜102上,通过反射进入图像采集系统104中,在眼睛图像中出现第二光斑。When the second light source 107 and the first light source 101 are located on both sides of the image acquisition system 104, the distance between the second light source 107 and the image acquisition system 104 may also be greater than or equal to the distance between the first light source 101 and the image acquisition system 104. The cornea 102 in the eye of the target object is deviated to the setting position of the second light source 107 with the line of sight. The light generated by the second light source 107 can directly irradiate the cornea 102 in the eye of the target object and enter the image acquisition system 104 through reflection. A second flare appears in the eye image.
在具体实施时,图5为本申请实施例提供的光源和图像采集系统的结构示意图,如图5所示,其中,图像采集系统104可以包括第一图像采集设备1041和第二图像采集设备1042,其中眼睛图像可以由第一图像采集设备1041对目标对象的眼睛进行拍摄得到,其中第一图像采集设备1041 的焦距小于或等于图像采集系统104中除第一图像采集设备1041的其他图像采集设备的焦距,例如第一图像采集设备1041的焦距小于或等于第二图像采集设备1042的焦距。In specific implementation, FIG. 5 is a schematic structural diagram of a light source and an image acquisition system according to an embodiment of the present application. As shown in FIG. 5, the image acquisition system 104 may include a first image acquisition device 1041 and a second image acquisition device 1042. The eye image can be obtained by photographing the eyes of the target object by the first image acquisition device 1041, and the focal length of the first image acquisition device 1041 is less than or equal to other image acquisition devices in the image acquisition system 104 except the first image acquisition device 1041 , For example, the focal length of the first image acquisition device 1041 is smaller than or equal to the focal length of the second image acquisition device 1042.
第一光源101可以包括第一红外光源1011和第二红外光源1012,其中第一红外光源1011和第二红外光源1012分别设置于图像采集系统104的两侧,相应的,第二光源107可以包括第三红外光源1071和第四红外光源1072,第三红外光源1071和第四红外光源1072分别设置于图像采集系统104的两侧。The first light source 101 may include a first infrared light source 1011 and a second infrared light source 1012. The first infrared light source 1011 and the second infrared light source 1012 are respectively disposed on two sides of the image acquisition system 104. Accordingly, the second light source 107 may include The third infrared light source 1071 and the fourth infrared light source 1072, and the third infrared light source 1071 and the fourth infrared light source 1072 are respectively disposed on two sides of the image acquisition system 104.
第一光源101工作时,第一红外光源1011和第二红外光源1012可以同时工作,也可以只有其中之一工作,第二光源107工作时,第三红外光源1071和第四红外光源1072可以同时工作,也可以只有其中之一工作。在开启第二光源107的同时,可以关闭第一光源101,也可以不关闭第一光源101。When the first light source 101 is working, the first infrared light source 1011 and the second infrared light source 1012 may work at the same time, or only one of them may work. When the second light source 107 is working, the third infrared light source 1071 and the fourth infrared light source 1072 may work simultaneously. Work, or only one of them. When the second light source 107 is turned on, the first light source 101 may be turned off, or the first light source 101 may not be turned off.
在丢失第一红外光源1011经角膜102反射形成的第一光斑时,可以开启与第一红外光源1011同侧的第三红外光源1071,也可以开启与第一红外光源1011不同侧的第四红外光源1072,其中,第四红外光源1072与第一图像采集设备1041的距离可以小于第一红外光源1011与第一图像采集设备1041的距离,也可以大于或等于第一红外光源1011与第一图像采集设备1041的距离;在丢失第二红外光源1012经角膜102反射形成的第一光斑时,可以开启与第二红外光源1012同侧的第四红外光源1072,也可以开启与第二红外光源1012不同侧的第三红外光源1071,其中,第三红外光源1071与第一图像采集设备1041的距离可以小于第二红外光源1012与第一图像采集设备1041的距离,也可以大于或等于第二红外光源1012与第一图像采集设备1041的距离。When the first light spot formed by the first infrared light source 1011 reflected by the cornea 102 is lost, the third infrared light source 1071 on the same side as the first infrared light source 1011 may be turned on, or the fourth infrared light source on the different side from the first infrared light source 1011 may be turned on. Light source 1072, wherein the distance between the fourth infrared light source 1072 and the first image acquisition device 1041 may be smaller than the distance between the first infrared light source 1011 and the first image acquisition device 1041, or may be greater than or equal to the first infrared light source 1011 and the first image The distance of the acquisition device 1041; when the first light spot formed by the second infrared light source 1012 reflected by the cornea 102 is lost, the fourth infrared light source 1072 on the same side as the second infrared light source 1012 can be turned on, or the second infrared light source 1012 can be turned on The third infrared light source 1071 on a different side, wherein the distance between the third infrared light source 1071 and the first image acquisition device 1041 may be smaller than the distance between the second infrared light source 1012 and the first image acquisition device 1041, or may be greater than or equal to the second infrared The distance between the light source 1012 and the first image acquisition device 1041.
在本申请实施例中,还可以根据眼睛图像的特征确定目标对象与图像采集系统之间的距离,具体的,可以通过眼睛图像中的瞳孔直径来确定目标对象与图像采集系统之间的距离,也可以通过眼睛图像中的瞳孔间的距离来确定目标对象与图像采集系统之间的距离,还可以通过其他眼睛图像的特征来确定,在此不做一一举例。In the embodiment of the present application, the distance between the target object and the image acquisition system may also be determined according to the characteristics of the eye image. Specifically, the distance between the target object and the image acquisition system may be determined by the pupil diameter in the eye image. The distance between the target object and the image acquisition system can also be determined by the distance between the pupils in the eye image, and can also be determined by the characteristics of other eye images, and no examples are given here.
举例来说,若瞳孔直径小于或等于预设直径,则说明目标对象与图像采集系统之间的距离较远,此时可判断目标对象与图像采集系统之间的距离大于或等于预设长度,或者,若瞳孔间的距离小于或等于预设距离,则可判断目标对象与图像采集系统之间的距离大于或等于预设长度。For example, if the pupil diameter is less than or equal to the preset diameter, it means that the distance between the target object and the image acquisition system is far, and at this time, it can be determined that the distance between the target object and the image acquisition system is greater than or equal to the preset length. Alternatively, if the distance between the pupils is less than or equal to a preset distance, it can be determined that the distance between the target object and the image acquisition system is greater than or equal to a preset length.
在目标对象与图像采集系统之间的距离大于或等于预设长度时,若第一光源101处于关闭状态,可开启第一光源101。When the distance between the target object and the image acquisition system is greater than or equal to the preset length, if the first light source 101 is turned off, the first light source 101 may be turned on.
本申请实施例提供了一种光源控制方法,通过判断眼睛图像中是否存在第一光斑,其中眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,第一光斑为第一光源产生的光经眼睛中的角膜反射到图像采集系统中形成的,若判断眼睛图像中不存在第一光斑,可以开启第二光源,以便第二光源产生的光经眼睛中的角膜反射到图像采集系统中形成第二光斑,其中第二光源与第一光源分别位于图像采集系统的两侧,和/或,第二光源与图像采集系统的距离小于第一光源与图像采集系统的距离。由于眼睛图像中丢失光斑通常是由于眼睛距离图像采集系统较近所致,此时第一光源产生的光不能经眼睛中的角膜反射,或经眼睛中的角膜反射后不能正常进入图像采集系统中,因此在眼睛图像中不存在第一光斑时,开启第二光源,由于第二光源与图像采集系统的距离较近,和/或,第二光源与第一光源分别位于图像采集系统的两侧,使第二光源产生的光能够顺利通过眼睛中的角膜反射进入图像采集系统中,从而在眼睛图像中形成第二光斑,以便根据第二光斑和眼睛特征进行注视点的计算,提高注视点计算的准确性。An embodiment of the present application provides a method for controlling a light source, by determining whether a first light spot exists in an eye image, where the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is generated by the first light source The light is formed by reflecting the cornea in the eye into the image acquisition system. If it is determined that there is no first light spot in the eye image, the second light source can be turned on so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition system. A second light spot is formed, wherein the second light source and the first light source are respectively located on two sides of the image acquisition system, and / or the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system. Because the missing light spot in the eye image is usually caused by the eye being closer to the image acquisition system, the light generated by the first light source cannot be reflected by the cornea in the eye, or cannot enter the image acquisition system normally after the corneal reflection in the eye. Therefore, when the first light spot does not exist in the eye image, the second light source is turned on, because the second light source is closer to the image acquisition system, and / or, the second light source and the first light source are located on both sides of the image acquisition system, respectively, Enable the light generated by the second light source to pass through the corneal reflection in the eye and enter the image acquisition system, thereby forming a second light spot in the eye image, so as to calculate the fixation point according to the second light spot and eye characteristics, and improve the calculation of the fixation point accuracy.
基于以上实施例提供的一种光源控制方法,本申请实施例还提供了一种光源控制装置,下面结合附图来详细说明其工作原理。Based on the light source control method provided by the above embodiments, the embodiment of the present application further provides a light source control device. The working principle is described in detail below with reference to the accompanying drawings.
图6为本申请实施例提供的一种光源控制装置的结构框图,如图6所示,该装置包括:FIG. 6 is a structural block diagram of a light source control device according to an embodiment of the present application. As shown in FIG. 6, the device includes:
判断单元110,设置为判断眼睛图像中是否存在第一光斑;所述眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,所述第一光斑为第一光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成 的;The determining unit 110 is configured to determine whether a first light spot exists in an eye image; the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is light generated by a first light source through the light source. Formed by the cornea in the eye reflecting into the image acquisition system;
第二光源开启单元120,设置为若判断单元的判断结果为否,则开启第二光源,以便所述第二光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成第二光斑;所述第二光源与所述图像采集系统的距离小于所述第一光源与所述图像采集系统的距离。The second light source turning-on unit 120 is configured to turn on the second light source if the determination result of the determining unit is no, so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition system to form a first Two light spots; the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system.
可选的,所述第一光源包括至少一个红外光源,所述第二光源包括至少一个红外光源。Optionally, the first light source includes at least one infrared light source, and the second light source includes at least one infrared light source.
可选的,所述第一光源包括第一红外光源和第二红外光源,所述第一红外光源和所述第二红外光源分别设置于所述图像采集系统的两侧;Optionally, the first light source includes a first infrared light source and a second infrared light source, and the first infrared light source and the second infrared light source are respectively disposed on two sides of the image acquisition system;
所述第二光源包括第三红外光源和第四红外光源,所述第三红外光源和所述第四红外光源分别设置于所述图像采集系统的两侧。The second light source includes a third infrared light source and a fourth infrared light source, and the third infrared light source and the fourth infrared light source are respectively disposed on two sides of the image acquisition system.
可选的,所述图像采集系统包括至少两个图像采集设备;所述眼睛图像通过第一图像采集设备对目标对象的眼睛进行拍摄得到,其中所述第一图像采集设备的焦距小于或等于所述图像采集系统中除第一图像采集设备的其他图像采集设备的焦距。Optionally, the image acquisition system includes at least two image acquisition devices; the eye image is obtained by photographing the eyes of the target object through a first image acquisition device, wherein a focal length of the first image acquisition device is less than or equal to The focal lengths of other image acquisition devices except the first image acquisition device in the image acquisition system are described.
可选的,所述装置还包括:Optionally, the device further includes:
第一光源开启单元,设置为根据所述眼睛图像的特征确定所述目标对象与所述图像采集设备之间的距离,若所述距离大于或等于预设长度,所述第一光源处于关闭状态,则开启所述第一光源。The first light source turning-on unit is configured to determine a distance between the target object and the image acquisition device according to a feature of the eye image. If the distance is greater than or equal to a preset length, the first light source is in an off state. , The first light source is turned on.
本申请实施例提供了一种光源控制装置,通过判断眼睛图像中是否存在第一光斑,其中眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,第一光斑为第一光源产生的光经眼睛中的角膜反射到图像采集系统中形成的,若判断眼睛图像中不存在第一光斑,可以开启第二光源,以便第二光源产生的光经眼睛中的角膜反射到图像采集系统中形成第二光斑,其中第二光源与第一光源分别位于图像采集系统的两侧,和/或,第二光源与图像采集系统的距离小于第一光源与图像采集系统的距离。由于眼睛图像中丢失光斑通常是由于眼睛距离图像采集系统较近所致,此时第一光源产生的光不能经眼睛中的角膜反射,或经眼睛中的角膜反射后不能正常进入图像采集系统中,因此在眼睛图像中不存在第一光斑时,开启第二 光源,由于第二光源与图像采集系统的距离较近,和/或,第二光源与第一光源分别位于图像采集系统的两侧,使第二光源产生的光能够顺利通过眼睛中的角膜反射进入图像采集系统中,从而在眼睛图像中形成第二光斑,以便根据第二光斑和眼睛特征进行注视点的计算,提高注视点计算的准确性。An embodiment of the present application provides a light source control device, which determines whether a first light spot exists in an eye image, where the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is generated by the first light source The light is formed by reflecting the cornea in the eye into the image acquisition system. If it is determined that there is no first light spot in the eye image, the second light source can be turned on so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition system. A second light spot is formed, wherein the second light source and the first light source are respectively located on two sides of the image acquisition system, and / or the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system. Because the missing light spot in the eye image is usually caused by the eye being closer to the image acquisition system, the light generated by the first light source cannot be reflected by the cornea in the eye, or cannot enter the image acquisition system normally after the corneal reflection in the eye. Therefore, when the first light spot does not exist in the eye image, the second light source is turned on, because the second light source is closer to the image acquisition system, and / or, the second light source and the first light source are located on both sides of the image acquisition system, respectively, Enable the light generated by the second light source to pass through the corneal reflection in the eye and enter the image acquisition system, thereby forming a second light spot in the eye image, so as to calculate the fixation point according to the second light spot and eye characteristics, and improve the calculation of the fixation point accuracy.
当介绍本申请的各种实施例的元件时,冠词“一”、“一个”、“这个”和“所述”都意图表示有一个或多个元件。词语“包括”、“包含”和“具有”都是包括性的并意味着除了列出的元件之外,还可以有其它元件。When introducing elements of various embodiments of the present application, the articles "a," "an," "the," and "said" are intended to mean that there are one or more of the elements. The words "including," "including," and "having" are all inclusive and mean that there may be additional elements other than the listed elements.
需要说明的是,本领域普通技术人员可以理解实现上述方法实施例中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。其中,所述存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。It should be noted that a person of ordinary skill in the art can understand that the implementation of all or part of the processes in the foregoing method embodiments can be completed by using a computer program to instruct related hardware. The program can be stored in a computer-readable storage In the medium, when the program is executed, it may include the processes of the foregoing method embodiments. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM).
本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于装置实施例而言,由于其基本相似于方法实施例,所以描述得比较简单,相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元及模块可以是或者也可以不是物理上分开的。另外,还可以根据实际的需要选择其中的部分或者全部单元和模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, as for the device embodiment, since it is basically similar to the method embodiment, it is described relatively simply, and the relevant part may refer to the description of the method embodiment. The device embodiments described above are merely schematic, and the units and modules described as separate components may or may not be physically separated. In addition, some or all of the units and modules may be selected according to actual needs to achieve the objective of the solution of this embodiment. Those of ordinary skill in the art can understand and implement without creative efforts.
以上所述仅是本申请的具体实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本申请原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本申请的保护范围。The above description is only a specific implementation of the present application. It should be noted that, for those of ordinary skill in the art, without departing from the principle of the present application, several improvements and retouching can be made. These improvements and retouching also It should be regarded as the scope of protection of this application.

Claims (12)

  1. 一种光源控制方法,所述方法包括:A light source control method, the method includes:
    判断眼睛图像中是否存在第一光斑;所述眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,所述第一光斑为第一光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成的;Determine whether there is a first light spot in the eye image; the eye image is obtained by shooting an eye of the target object through an image acquisition system, and the first light spot is the light generated by the first light source reflected by the cornea in the eye to Formed in the image acquisition system;
    若否,则开启第二光源,以便所述第二光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成第二光斑;所述第二光源与所述第一光源分别位于所述图像采集系统的两侧,和/或,所述第二光源与所述图像采集系统的距离小于所述第一光源与所述图像采集系统的距离。If not, turn on the second light source, so that the light generated by the second light source is reflected by the cornea in the eye to the image acquisition system to form a second light spot; the second light source is separate from the first light source Located on both sides of the image acquisition system, and / or, the distance between the second light source and the image acquisition system is smaller than the distance between the first light source and the image acquisition system.
  2. 根据权利要求1所述的方法,其中,所述第一光源包括至少一个红外光源,所述第二光源包括至少一个红外光源。The method of claim 1, wherein the first light source comprises at least one infrared light source and the second light source comprises at least one infrared light source.
  3. 根据权利要求2所述的方法,其中,所述第一光源包括第一红外光源和第二红外光源,所述第一红外光源和所述第二红外光源分别设置于所述图像采集系统的两侧;The method according to claim 2, wherein the first light source comprises a first infrared light source and a second infrared light source, and the first infrared light source and the second infrared light source are respectively disposed in two of the image acquisition system. side;
    所述第二光源包括第三红外光源和第四红外光源,所述第三红外光源和所述第四红外光源分别设置于所述图像采集系统的两侧。The second light source includes a third infrared light source and a fourth infrared light source, and the third infrared light source and the fourth infrared light source are respectively disposed on two sides of the image acquisition system.
  4. 根据权利要求1至3任意一项所述的方法,其中,所述图像采集系统包括至少两个图像采集设备;所述眼睛图像通过第一图像采集设备对目标对象的眼睛进行拍摄得到,其中所述第一图像采集设备的焦距小于或等于所述图像采集系统中除第一图像采集设备的其他图像采集设备的焦距。The method according to any one of claims 1 to 3, wherein the image acquisition system includes at least two image acquisition devices; the eye image is obtained by photographing the eyes of the target object through a first image acquisition device, wherein The focal length of the first image acquisition device is less than or equal to the focal length of other image acquisition devices in the image acquisition system except the first image acquisition device.
  5. 根据权利要求1至3任意一项所述的方法,其中,所述方法还包括:The method according to any one of claims 1 to 3, wherein the method further comprises:
    根据所述眼睛图像的特征确定所述目标对象与所述图像采集设备之间的距离,若所述距离大于或等于预设长度,所述第一光源处于关闭状态,则开启所述第一光源。Determine the distance between the target object and the image acquisition device according to the characteristics of the eye image, and if the distance is greater than or equal to a preset length, and the first light source is turned off, the first light source is turned on .
  6. 一种光源控制装置,所述装置包括:A light source control device, the device includes:
    判断单元,设置为判断眼睛图像中是否存在第一光斑;所述眼睛图像是通过图像采集系统对目标对象的眼睛进行拍摄得到的,所述第一光斑为第一光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成的;A judging unit configured to judge whether a first light spot exists in an eye image; the eye image is obtained by shooting an eye of a target object through an image acquisition system, and the first light spot is light generated by a first light source passing through the eyes The cornea formed by reflection in the image acquisition system;
    第二光源开启单元,设置为若判断单元的判断结果为否,则开启第二 光源,以便所述第二光源产生的光经所述眼睛中的角膜反射到所述图像采集系统中形成第二光斑;所述第二光源与所述第一光源分别位于所述图像采集系统的两侧,和/或,所述第二光源与所述图像采集系统的距离小于所述第一光源与所述图像采集系统的距离。The second light source turning-on unit is configured to turn on the second light source if the judgment result of the judging unit is no, so that light generated by the second light source is reflected by the cornea in the eye to the image acquisition system to form a second Light spot; the second light source and the first light source are located on both sides of the image acquisition system, and / or, the distance between the second light source and the image acquisition system is smaller than the first light source and the The distance of the image acquisition system.
  7. 根据权利要求6所述的装置,其中,所述第一光源包括至少一个红外光源,所述第二光源包括至少一个红外光源。The apparatus of claim 6, wherein the first light source includes at least one infrared light source, and the second light source includes at least one infrared light source.
  8. 根据权利要求7所述的装置,其中,所述第一光源包括第一红外光源和第二红外光源,所述第一红外光源和所述第二红外光源分别设置于所述图像采集系统的两侧;The device according to claim 7, wherein the first light source comprises a first infrared light source and a second infrared light source, and the first infrared light source and the second infrared light source are respectively disposed in two of the image acquisition system. side;
    所述第二光源包括第三红外光源和第四红外光源,所述第三红外光源和所述第四红外光源分别设置于所述图像采集系统的两侧。The second light source includes a third infrared light source and a fourth infrared light source, and the third infrared light source and the fourth infrared light source are respectively disposed on two sides of the image acquisition system.
  9. 根据权利要求6至8任意一项所述的装置,其中,所述图像采集系统包括至少两个图像采集设备;所述眼睛图像通过第一图像采集设备对目标对象的眼睛进行拍摄得到,其中所述第一图像采集设备的焦距小于或等于所述图像采集系统中除第一图像采集设备的其他图像采集设备的焦距。The apparatus according to any one of claims 6 to 8, wherein the image acquisition system includes at least two image acquisition devices; the eye image is obtained by photographing an eye of a target object through a first image acquisition device, wherein The focal length of the first image acquisition device is less than or equal to the focal length of other image acquisition devices in the image acquisition system except the first image acquisition device.
  10. 根据权利要求6至8任意一项所述的装置,其中,所述装置还包括:The device according to any one of claims 6 to 8, wherein the device further comprises:
    第一光源开启单元,设置为根据所述眼睛图像的特征确定所述目标对象与所述图像采集设备之间的距离,若所述距离大于或等于预设长度,所述第一光源处于关闭状态,则开启所述第一光源。The first light source turning-on unit is configured to determine a distance between the target object and the image acquisition device according to a feature of the eye image. If the distance is greater than or equal to a preset length, the first light source is in an off state. , The first light source is turned on.
  11. 一种存储介质,所述存储介质包括存储的程序,其中,在所述程序运行时控制所述存储介质所在设备执行权利要求1至5中任意一项所述的光源控制方法。A storage medium comprising a stored program, wherein when the program is run, a device where the storage medium is located is controlled to perform the light source control method according to any one of claims 1 to 5.
  12. 一种设备,包括存储器和处理器,A device including a memory and a processor,
    所述存储器存储有计算机程序;A computer program is stored in the memory;
    所述处理器,设置为执行所述存储器中存储的计算机程序,所述计算机程序运行时执行权利要求1至5中任意一项所述的光源控制方法。The processor is configured to execute a computer program stored in the memory, and when the computer program runs, the light source control method according to any one of claims 1 to 5 is executed.
PCT/CN2019/077213 2018-06-14 2019-03-06 Light source control method and apparatus WO2019237772A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810615522.0 2018-06-14
CN201810615522.0A CN108762511B (en) 2018-06-14 2018-06-14 Light source control method and device

Publications (1)

Publication Number Publication Date
WO2019237772A1 true WO2019237772A1 (en) 2019-12-19

Family

ID=64021759

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/077213 WO2019237772A1 (en) 2018-06-14 2019-03-06 Light source control method and apparatus

Country Status (2)

Country Link
CN (1) CN108762511B (en)
WO (1) WO2019237772A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108762511B (en) * 2018-06-14 2020-08-25 北京七鑫易维信息技术有限公司 Light source control method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20160055621A (en) * 2014-11-10 2016-05-18 현대자동차주식회사 Gaze tracking apparatus and method for detecting glint thereof
CN206505382U (en) * 2017-02-06 2017-09-19 上海青研科技有限公司 Binocular stereo vision ophthalmogyric device in a kind of VR/AR
CN108762511A (en) * 2018-06-14 2018-11-06 北京七鑫易维信息技术有限公司 A kind of light source control method and device

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5610673A (en) * 1995-09-14 1997-03-11 Pulse Medical Instruments, Inc. Pupil detection system
SE524003C2 (en) * 2002-11-21 2004-06-15 Tobii Technology Ab Procedure and facility for detecting and following an eye and its angle of view
GB2511868B (en) * 2013-03-15 2020-07-15 Tobii Ab Eye/gaze tracker and method of tracking the position of an eye and/or a gaze point of a subject
US9430040B2 (en) * 2014-01-14 2016-08-30 Microsoft Technology Licensing, Llc Eye gaze detection with multiple light sources and sensors
CN105303155B (en) * 2014-06-03 2019-11-15 虹膜识别系统公司 Iris identification equipment and its operating method
WO2016045911A1 (en) * 2014-09-25 2016-03-31 Philips Lighting Holding B.V. Control of lighting.
CN106339085B (en) * 2016-08-22 2020-04-21 华为技术有限公司 Terminal with sight tracking function, method and device for determining user viewpoint
CN107145086B (en) * 2017-05-17 2023-06-16 上海青研科技有限公司 Calibration-free sight tracking device and method
CN107463893A (en) * 2017-07-28 2017-12-12 广东欧珀移动通信有限公司 Iris identification method and mobile terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20160055621A (en) * 2014-11-10 2016-05-18 현대자동차주식회사 Gaze tracking apparatus and method for detecting glint thereof
CN206505382U (en) * 2017-02-06 2017-09-19 上海青研科技有限公司 Binocular stereo vision ophthalmogyric device in a kind of VR/AR
CN108762511A (en) * 2018-06-14 2018-11-06 北京七鑫易维信息技术有限公司 A kind of light source control method and device

Also Published As

Publication number Publication date
CN108762511A (en) 2018-11-06
CN108762511B (en) 2020-08-25

Similar Documents

Publication Publication Date Title
RU2399937C2 (en) Image forming apparatus, method of controlling image forming apparatus
US20120194784A1 (en) Iris image definition estimation system using the astigmatism of the corneal reflection of a non-coaxial light source
JP7008702B2 (en) Methods and systems for eye tracking using speckle patterns
US10156899B2 (en) Dynamic camera or light operation
KR102073460B1 (en) Head-mounted eye tracking device and method that provides drift-free eye tracking through lens system
US20160249800A1 (en) Computational array camera with dynamic illumination for eye tracking
US10002293B2 (en) Image collection with increased accuracy
US9510751B2 (en) Ocular characteristic device to eliminate ghosting from an IOL during corneal curvature measurement
WO2019061079A1 (en) Focusing processing method and device
CN107533362A (en) Eye-tracking device and the method for operating eye-tracking device
TWI705354B (en) Eye tracking apparatus and light source control method thereof
JP2003521950A (en) Eye tracking system
WO2015014058A1 (en) System for detecting optical parameter of eye, and method for detecting optical parameter of eye
TW200826911A (en) Pupil reflection eye tracking system and associated methods
US20160041615A1 (en) Information processing apparatus, focus detection method, and information processing system
SE529763C2 (en) Automatic eye tracker for e.g. controlling computer system, has mask to alter basic optical transfer function of lens structure and image sensor into enhanced optical transfer function
RU2013135503A (en) OPHTHALMIC DEVICE AND OPHTHALMIC METHOD
WO2019237772A1 (en) Light source control method and apparatus
US11054659B2 (en) Head mounted display apparatus and distance measurement device thereof
JP2016049261A (en) Illumination imaging device and visual axis detecting apparatus
JP6916283B2 (en) Identification of ocular surface shape using multifocal keratometry
JP2021175419A5 (en)
TWI623909B (en) Calculus aiming method, system and computer program product
TWI464690B (en) An iris image definition estimation system using the astigmatism of the corneal reflection of a non-coaxial light source
JPH089205A (en) Picture monitor device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19819413

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 01.04.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19819413

Country of ref document: EP

Kind code of ref document: A1