WO2018177311A1 - 视线追踪装置及头戴式显示设备 - Google Patents

视线追踪装置及头戴式显示设备 Download PDF

Info

Publication number
WO2018177311A1
WO2018177311A1 PCT/CN2018/080811 CN2018080811W WO2018177311A1 WO 2018177311 A1 WO2018177311 A1 WO 2018177311A1 CN 2018080811 W CN2018080811 W CN 2018080811W WO 2018177311 A1 WO2018177311 A1 WO 2018177311A1
Authority
WO
WIPO (PCT)
Prior art keywords
infrared
line
infrared light
tracking device
brightness
Prior art date
Application number
PCT/CN2018/080811
Other languages
English (en)
French (fr)
Inventor
刘金星
黄通兵
Original Assignee
北京七鑫易维信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京七鑫易维信息技术有限公司 filed Critical 北京七鑫易维信息技术有限公司
Priority to US16/347,580 priority Critical patent/US11143869B2/en
Priority to EP18776251.3A priority patent/EP3522070A4/en
Priority to JP2019527512A priority patent/JP6837142B2/ja
Priority to KR1020197024516A priority patent/KR102226447B1/ko
Priority to CA3042617A priority patent/CA3042617C/en
Priority to AU2018243092A priority patent/AU2018243092A1/en
Publication of WO2018177311A1 publication Critical patent/WO2018177311A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141—Control of illumination
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/71—Circuitry for evaluating the brightness variation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/30—Transforming light or analogous information into electric information
    • H04N5/33—Transforming infrared radiation

Definitions

  • the present application relates to the field of electronic device technologies, and in particular to a line-of-sight tracking device and a head mounted display device.
  • the existing gaze tracking device can simultaneously have a gaze tracking function and an iris recognition function. On the one hand, the gaze tracking device can acquire the direction of the user's line of sight and at the same time accurately identify the user.
  • Different image recognition algorithms determine the gaze point position and user identity information of the eye.
  • the number of infrared lamps that achieve effective working brightness does not change, that is, the infrared lamp is effective in iris recognition and line-of-sight tracking.
  • the number of infrared lamps that work in brightness is the same. Therefore, when the number of infrared lamps that achieve the effective working brightness is large, the line-of-sight tracking device works in the iris recognition.
  • the infrared image captured by the infrared camera includes more infrared spots, the iris image is partially blocked, resulting in failure to obtain. All eye features. Or when the number of infrared lamps is small, when the line-of-sight tracking device works in line-of-sight tracking, since the infrared spot on the eyeball image collected by the infrared camera is small, it is easy to collect the infrared spot on the iris area, resulting in the line of sight direction calculation. Inaccurate or impossible to calculate.
  • the purpose of the embodiments of the present application is to provide a gaze tracking device and a head-mounted display device to reduce the number of infrared lamps in an infrared light group that achieve effective working brightness when the line-of-sight tracking device operates on iris recognition.
  • the interference problem of excessive infrared light on the collection of eye feature values, and the number of infrared lamps that achieve effective working brightness when the line-of-sight tracking device works in line-of-sight tracking makes the line of sight tracking more accurate.
  • an embodiment of the present application provides a gaze tracking device, including an infrared camera, an infrared light group, and a control circuit, wherein the control circuit is electrically connected to the infrared light group, and the infrared light group includes at least two settings. Infrared lights at different locations;
  • the infrared camera is configured to collect an eyeball image of the user when the infrared lamp is lit;
  • the control circuit is configured to respectively control the number of infrared lamps in the infrared light group that reach an effective working brightness when the line-of-sight tracking device operates on iris recognition and line-of-sight tracking, and the effective working brightness means that the brightness is not less than Threshold brightness.
  • the embodiment of the present application provides a first possible implementation manner of the first aspect, where the infrared light group includes an infrared light group disposed at a first position and an infrared light group disposed at the second position, and configured
  • the infrared light emitted during the operation of the infrared lamp group in the first position does not directly illuminate the eyeball of the user, and the infrared light emitted during the operation of the infrared lamp group disposed in the second position directly illuminates the eyeball of the user;
  • the control circuit is configured to control the infrared light group disposed at the first position to achieve an effective working brightness when the line-of-sight tracking device operates in iris recognition, and to control the second light position when the line-of-sight tracking device operates in line of sight tracking
  • the infrared light group achieves effective working brightness
  • the embodiment of the present application provides a second possible implementation manner of the first aspect, where the infrared camera is electrically connected to the control circuit;
  • the infrared camera is further configured to transmit the eyeball image and the infrared light to the iris image formed on the infrared camera to the control circuit;
  • the control circuit is further configured to adjust a brightness of the infrared lamp that reaches an effective working brightness such that a gray value of the eyeball image reaches a preset gray value.
  • the embodiment of the present application provides a third possible implementation manner of the first aspect, where the infrared light group includes a first infrared light and a second infrared light, the number of the first infrared light is less than the The number of second infrared lamps;
  • the control circuit is configured to control the first infrared light to reach an effective working brightness when the line-of-sight tracking device operates in iris recognition, and control the brightness of the second infrared light to be less than the threshold brightness; and, set to When the line-of-sight tracking device operates in line-of-sight tracking, the brightness of the first infrared lamp is controlled to be less than the threshold brightness, and the second infrared lamp is controlled to achieve an effective working brightness.
  • the embodiment of the present application provides a fourth possible implementation manner of the first aspect, where the control circuit is electrically connected to each of the infrared lamps respectively;
  • the control circuit is configured to control the first set number of the infrared lamps to achieve an effective working brightness when the line-of-sight tracking device operates in iris recognition; and to set the line-of-sight tracking device to operate in line of sight tracking And controlling the second set number of the infrared lamps to reach an effective working brightness; the first set number is less than the second set number.
  • the embodiment of the present application provides a fifth possible implementation manner of the first aspect, where the infrared light group of the first location includes at least two infrared lights, the The two-position infrared light group includes at least three infrared lamps;
  • the illumination wavelength of each of the infrared lamps in the first position is smaller than the illumination wavelength of the infrared lamps in the infrared lamp group in the second position.
  • the embodiment of the present application provides a sixth possible implementation manner of the first aspect, wherein at least two infrared lamps in the infrared light group in the first position have different illumination wavelengths .
  • the embodiment of the present application provides a seventh possible implementation manner of the first aspect, where the infrared camera includes a first infrared camera and a second infrared camera, and the control circuit It is also arranged to control the operation of the first infrared camera when the line-of-sight tracking device operates in the iris recognition; and control the operation of the second infrared camera when the line-of-sight tracking device operates in the line of sight tracking.
  • control circuit is further configured to control the infrared camera to start working when the infrared light reaches an effective working brightness.
  • the embodiment of the present application provides a head mounted display device, comprising any one of the first aspect to the eighth possible implementation manner of the first aspect.
  • a line-of-sight tracking device and a head-mounted display device provided by the embodiments of the present application have an infrared lamp group including at least two infrared lamps disposed at different positions, and the control circuit is in a line of sight, compared with the line-of-sight tracking device in the prior art.
  • the tracking device is capable of separately controlling the number of infrared lamps in the infrared light group that reach the effective working brightness when the iris recognition and the line of sight are tracked, so that the line-of-sight tracking device achieves the effective working brightness of the infrared lamp in the two working states.
  • the number is different, so that the line-of-sight tracking device can separately control the number of infrared lamps in the infrared light group that reach the effective working brightness when working on iris recognition and line-of-sight tracking, so that the line-of-sight tracking device works effectively in iris recognition.
  • the number of infrared lamps is small, so that the infrared camera obtains no more infrared spots on the user's eyeball image, so that the user identity can be recognized by acquiring all the eye features.
  • the number of infrared lamps that make the line-of-sight tracking device work effectively at the time of line-of-sight tracking, so that the infrared light spot on the user's eyeball image obtained by the infrared camera is more, so that the user's line of sight direction is more accurately obtained.
  • FIG. 1 is a schematic structural diagram of a gaze tracking device according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of a physical object of a circular ring infrared light panel provided by an embodiment of the present application
  • FIG. 3 is a circuit diagram of a control circuit provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram showing the physical appearance of the head mounted virtual reality glasses provided by the embodiments of the present application.
  • Icons 101-infrared camera; 102-infrared light group; 103-control circuit; 1021-infrared light; 400-circular infrared light board; 401-glass frame; 402-lens.
  • Embodiment 1 of the present application provides a gaze tracking device, as shown in FIG. 1, including an infrared camera 101, and further includes an infrared light group 102 and a control circuit 103, wherein the control circuit 103 and the infrared light group 102 are electrically connected, wherein the infrared
  • the light group 102 includes at least two infrared lamps 1021 disposed at different positions, wherein the infrared camera 101 can be electrically connected to the control circuit 103.
  • the infrared camera 101 is arranged to collect an eyeball image of the user when the infrared lamp 1021 is illuminated.
  • the infrared camera 101 needs to collect the user's eyeball image when the infrared lamp 1021 is illuminated.
  • the control circuit 103 is configured to respectively control the number of the infrared lamps 1021 in the infrared light group 102 that reach the effective working brightness when the line-of-sight tracking device operates on the iris recognition and the line-of-sight tracking, and the effective working brightness means that the brightness is not less than the threshold brightness.
  • the infrared lamp 1021 which achieves the effective working brightness means that the infrared light of the brightness directly illuminates the eyeball of the user, and when the infrared camera 101 collects the image of the user's eyeball, the infrared spot collected in the iris area blocks the partial iris image, so that Unable to extract all eye features. If the brightness of the infrared lamp 1021 is extremely dark, when it is irradiated to the user's eyeball, the iris image in the eyeball image extracted by the infrared camera is not partially occluded, and does not affect the extraction of all the eye feature values, which is called the brightness portion of the portion. The dark infrared lamp 1021 does not reach an effective working brightness.
  • the infrared spot formed by the infrared lamp 1021 which achieves the effective working brightness is referred to as including the infrared spot
  • the infrared spot formed when the infrared lamp 1021 which does not reach the effective working brightness is irradiated to the eyeball image is referred to as not forming infrared.
  • Spot because the infrared spot at this time does not form interference when collecting the eye feature value, and does not play a role in calculating the line of sight direction when the line of sight is tracked.
  • the threshold brightness value can be obtained through multiple experiments.
  • the infrared light less than the threshold brightness illuminates the user's eyeball
  • the infrared spot of the iris image in the eyeball image acquired by the infrared camera is particularly low, or the infrared spot is particularly small. Does not affect the extraction of the user's eye feature values.
  • the infrared light group includes an infrared light group disposed at the first position and an infrared light group disposed at the second position, and is disposed at the first position
  • the infrared light emitted by the infrared light when working in the infrared light group does not directly illuminate the user's eyeball, and the infrared light emitted when the infrared light set in the second position is working directly illuminates the user's eyeball.
  • the control circuit is configured to control the infrared light group disposed at the first position to achieve an effective working brightness when the line-of-sight tracking device operates in the iris recognition, and control the infrared light group set in the second position to be effective when the line-of-sight tracking device operates in the line of sight tracking Working brightness.
  • the infrared lamp disposed in the first position does not directly illuminate the user's eyeball, and the infrared lamp at the position does not directly illuminate the human eye when reaching the effective working brightness, but illuminates other places, such as the user's eyelid, through
  • the diffuse reflection illuminates the human eye and then images on the infrared camera.
  • the infrared camera obtains the user's eyeball image, and the iris area on the eyeball image has no infrared spot.
  • the infrared lamp disposed in the second position directly illuminates the user's eyes when working, and is imaged on the infrared camera through the specular reflection of the eyeball.
  • the infrared camera obtains the eyeball image of the user, and the iris region on the eyeball image has an infrared spot.
  • two circular ring plates can be provided, one having a diameter slightly larger than the other, and a circular ring plate having a large diameter is sleeved on a circular ring plate having a smaller diameter, and a circular ring lamp having a larger diameter is used.
  • the board is placed far away from the user's eyeball, and the infrared light emitted by the board does not directly illuminate the user's eyeball, but illuminates the area around the eyeball. After the diffuse reflection of the area, a part of the diffuse reflection light illuminates the user's eyeball, and then The infrared camera is imaged so that there is no infrared spot on the eyeball image acquired by the infrared camera.
  • the infrared light group disposed in the first position includes at least two infrared lamps
  • the infrared light group disposed in the second position includes at least three infrared lamps, and each of the infrared lamps in the first position
  • the illuminating wavelength of the infrared lamp of the infrared lamp group is smaller than the illuminating wavelength of the infrared lamp group of the second position.
  • the iris recognition in order to improve the iris recognition rate of the user's eyeball image, it is convenient to extract the iris feature value, generally adopting infrared light with a wavelength between 760 nm and 850 nm, and in the line of sight tracking, in order to improve the clarity of the infrared spot in the eyeball image.
  • infrared light with a wavelength between 850 nm and 940 nm is generally used.
  • the iris recognition rate is affected by the wavelength of the infrared light, it is also affected by the color of the iris region in the user's eyes. Therefore, in an optional embodiment, in the technical solution proposed in Embodiment 1 of the present application, at least two infrared lamps in the infrared lamp group disposed in the first position have different illumination wavelengths, for example, including three infrared rays.
  • the lamps which emit infrared light at wavelengths of 770 nm, 810 nm, and 840 nm, respectively.
  • the lights of the three wavelengths are effectively operated, and the three images obtained by the infrared camera are respectively viewed, and the clearest image is obtained, that is, the gray value is the largest.
  • the corresponding infrared light is the most suitable infrared light for the user.
  • the infrared camera includes a first infrared camera and a second infrared camera, and the control circuit is further configured to control the first infrared camera when the line-of-sight tracking device works on the iris recognition. Work; control the second infrared camera when the line-of-sight tracking device works in line-of-sight tracking.
  • the wavelength of the infrared light received by the first infrared camera is smaller than the wavelength of the infrared light received by the second infrared camera.
  • the number of the infrared lamps 1021 that control the effective working brightness in the infrared light group 102 is controlled differently, so that the ray line tracking device works on the iris recognition, and the infrared camera 101 collects the user's
  • the infrared light spot is not included in the eyeball image or includes a small number of infrared light spots, so that there is excessive infrared light spot on the eyeball image acquired by the infrared camera 101, so that all the feature values of the eyeball cannot be extracted, and the film recognition cannot be completed.
  • the infrared light 1021 which has more effective working brightness illuminates the cornea area of the user's eyeball, so that the eyeball image acquired by the infrared camera 101 is distributed near the pupil center of the eyeball.
  • the infrared spot is more accurate, and the user's line of sight can be determined more accurately by calculating the distance between the pupil center and each infrared spot.
  • the gaze tracking device may be configured as a virtual reality device, or may be configured as an augmented reality device or a head-mounted eye control device, and the device may have an iris recognition function for the user and determine a line of sight direction of the user, and the specific application environment is This is not specifically limited.
  • the control circuit 103 includes a processor that can adjust the number of infrared lamps 1021 in the infrared light group 102 that reach an effective operating brightness by outputting a pulse width modulation signal.
  • the previous current test can be used to obtain the lowest current value when the infrared lamp 1021 reaches the effective working brightness, and the current can be adjusted by outputting the pulse width modulation signal so that the current is greater than or equal to the minimum current value.
  • the iris image in the eye image acquired by the infrared camera or the infrared spot in the iris image is not clear, and the brightness of the infrared lamp 1021 can be adjusted.
  • the iris image and the infrared spot are made clear.
  • Embodiment 1 of the present application An optional implementation manner is proposed in Embodiment 1 of the present application. As shown in FIG. 1, the infrared camera 101 is electrically connected to the control circuit 103.
  • the infrared camera 101 is further configured to transmit the acquired eye image of the user to the control circuit 103.
  • the control circuit 103 is further configured to adjust the brightness of the infrared lamp 1021 that reaches the effective working brightness so that the gray value of the eyeball image reaches a preset gray value.
  • This case includes: when the gaze tracking device operates on iris recognition, the control circuit 103 adjusts the gradation value of the texture image in the image of the user's eyeball, so that the texture is more clear, and the recognition degree of the texture is increased, so that the iris recognition can be completed quickly.
  • the control circuit 103 adjusts the gray values of the pupils and infrared spots in the acquired eye image of the user to facilitate obtaining images of relatively clear pupils and infrared spots.
  • the grayscale value of the texture in the pre-stored eyeball image in the processor in the control circuit 103 is 108
  • the grayscale value of the preset spot image is 100
  • a grayscale value range is prestored.
  • the processor in the control circuit 103 can determine whether the gradation value of the received texture image reaches the preset gradation value 108, or whether the preset gradation value range is reached.
  • the brightness of the infrared lamp 1021 at this time is not adjusted. If not, the brightness of the infrared lamp 1021 can be adjusted by outputting a pulse width modulation signal.
  • the processor in the control circuit 103 can determine whether the gradation value of the image of the infrared spot in the received eyeball image reaches the preset gradation value 100, or whether a pre-stored gray is reached. If the range of degrees is reached, the brightness of the infrared lamp 1021 at this time is not adjusted. If not, the brightness of the infrared lamp 1021 can be adjusted by outputting a pulse width modulation signal.
  • pulse width modulation is an analog control method, which modulates the bias of the transistor base or the gate of the MOS transistor according to the change of the corresponding load, thereby realizing the change of the on-time of the transistor or the MOS transistor, thereby realizing the switching power supply.
  • the change in output This way, the output voltage of the power supply can be kept constant when the operating conditions change, which is a very effective technique for controlling the analog circuit by using the digital signal of the microprocessor.
  • the magnitude of the output current can be adjusted by adjusting the duty ratio of the pulse width modulation signal.
  • adjusting the brightness of the infrared lamp 1021 by outputting the pulse width modulation signal is merely an embodiment, and is not limited thereto. the way.
  • the infrared light group 102 includes a first infrared light and a second infrared light, and the number of the first infrared light is less than the number of the second infrared light;
  • the control circuit 103 is configured to control the first infrared light to reach an effective working brightness when the line-of-sight tracking device operates on the iris, to control the second infrared to be less than the threshold brightness, and to set the line-of-sight tracking device to operate in the line of sight tracking, and to control An infrared lamp is less than the threshold brightness, and the second infrared lamp is controlled to achieve an effective working brightness.
  • the brightness of the infrared light is controlled to be less than a threshold brightness, including directly turning off the infrared light.
  • the number of the first infrared lamps is one, and the number of the second infrared lamps is eight.
  • the first infrared lamp is controlled by the control circuit 103, that is, the infrared light is reached. Effective working brightness; when the line-of-sight tracking device operates in line-of-sight tracking, the second infrared lamp is controlled by the control circuit 103, that is, the 8 ⁇ infrared lamp reaches the effective working brightness.
  • the first infrared lamp and the second infrared lamp may be arranged in parallel, and each of the second infrared lamps is arranged in series.
  • control circuit 103 is electrically connected to each of the infrared lamps 1021 in the infrared light group 102;
  • control circuit 103 is configured to control the first set number of the infrared lamps 1021 to achieve the effective working brightness when the line-of-sight tracking device operates in the iris recognition, and to set the second control when the line-of-sight tracking device operates in the line of sight tracking.
  • the set number of infrared lamps 1021 reaches an effective working brightness; wherein the first set number is less than the second set number.
  • the first set number is one, and the second set number is eight.
  • the control circuit 103 controls the one-inch infrared lamp 1021 in the infrared light group 102 to reach the effective working brightness;
  • the control circuit 103 controls the 8 ⁇ infrared lamps in the infrared light group 102 to reach the effective working brightness, and the 8 ⁇ infrared lamps 1021 may include the 1 ⁇ infrared lamp illuminated in the iris recognition described above. 1021.
  • Embodiment 1 of the present application An optional implementation manner is provided in Embodiment 1 of the present application, in which the infrared lamps 1021 in the infrared light group 102 are connected in parallel.
  • the gaze tracking device further includes an infrared light board configured to carry the infrared light 1021, and the control circuit 103 and the infrared camera 101 may also be disposed at The infrared light board.
  • the infrared light board is a circular infrared light board 400, and each infrared light 1021 is evenly distributed on the circular infrared light board 400.
  • the infrared light group 102 has a total of 8 infrared light 1021.
  • the eight-inch infrared lamp 1021 is evenly distributed on the circular infrared lamp panel 400 to form a circle, and the intervals of adjacent infrared lamps are equal.
  • the control circuit 103 at this time is as shown in FIG. As shown in FIG.
  • the 8" infrared lamps 1021 are respectively connected to the pins 11-18 of the chip one by one, and each of the infrared lamps 1021 is connected in series with a pull-up resistor R.
  • the pins 11-18 of the chip output levels to control the corresponding connected infrared lamps 1021.
  • the pins 1-8 of the chip receive the control signals LED1 to LED8 one by one, and each control signal controls the corresponding infrared lamp 1021.
  • the line-of-sight tracking device also includes a power supply module configured to power the control circuit and the infrared camera.
  • control circuit is further configured to control the infrared camera to start working when the infrared light reaches the effective working brightness.
  • control circuit 103 is also capable of controlling the exposure time of the infrared camera 101 and the lighting and extinguishing time of the infrared lamp 1021.
  • the infrared camera exposure time is set to a fixed maximum value, and the control circuit works by adjusting the output pulse width modulation signal.
  • the infrared camera is controlled to output a shooting synchronization signal, and the infrared light that controls the operation of the line of sight is turned off after the shooting is completed.
  • the blinking frequency of the infrared light working on the line of sight tracking is the same as the infrared camera shooting frequency.
  • the control circuit When the line-of-sight tracking device works in the iris recognition, the control circuit also adjusts the infrared light of the iris recognition to the appropriate brightness by adjusting the output pulse width modulation signal, and controls the infrared camera to output the shooting synchronization signal, and the control works on the iris recognition after the shooting is completed.
  • the infrared light goes out.
  • the blinking frequency of the infrared lamp operating on the iris recognition is the same as that of the infrared camera.
  • the line of sight tracking device can select its working mode, for example, only the iris recognition mode is turned on, only the line of sight tracking mode is turned on or both working modes are turned on.
  • the gaze tracking device should be set to an environment that requires a high level of security, allowing the iris recognition mode to be turned on once at regular intervals. And the line-of-sight tracking device turns on the iris recognition function when performing line-of-sight tracking.
  • the control circuit controls an alternate cycle of line-of-sight tracking and iris recognition, and the control circuit controls the infrared camera to perform shooting when the infrared light of the corresponding mode is alternately illuminated.
  • the first frame image can be used as the eyeball image in the eye control mode
  • the second frame is the eyeball image in the iris recognition mode
  • the third frame is the eyeball image in the eye control mode, ... and so on
  • the eye control is realized at the same time.
  • the iris recognition mode such as the acquisition frequency of 60 fps
  • the eyeball image in the odd frame is acquired in one working mode
  • the eyeball image in the even frame is acquired in another working mode.
  • the human eye since the switching speeds of the two working modes are extremely fast, the human eye basically does not feel the switching of the infrared lamps operating in the two working modes.
  • the gaze tracking device can be installed in a virtual reality glasses, as shown in FIG. 4, the virtual reality glasses include a spectacles frame 401, the glasses frame includes a lens 402 corresponding to the eyes of the user, and the circular infrared light plate 400 The inner diameter is larger than the diameter of the lens 402, and the circular infrared light plate 400 is sleeved on the lens 402.
  • Embodiment 2 of the present application provides a head mounted display device, including any of the gaze tracking devices of Embodiment 1, further comprising a head mounted display device body, the body comprising a carrying device, the carrying device including a lens group And the display, the lens group includes a left lens or a right lens.
  • the lens group can be a convex lens or a concave lens, or a pair of goggles to suit the needs of different users, and the display screen is set to display an image.
  • the gaze tracking device of Embodiment 1 is configured to identify the identity of the user and determine the line of sight direction of the user, and the infrared camera, the infrared light group and the control circuit in the gaze tracking device can be mounted on a circular infrared light board, The design space of the above-mentioned head-mounted display device can be saved, and the circular-shaped infrared light plate can be designed to have an inner diameter slightly larger than the diameter of the left lens head or the right lens head in the lens group.
  • An optional implementation manner has two circular infrared light panels respectively disposed on the left lens head and the right lens head, and eight infrared lamps and one uniform are respectively arranged on the circular infrared light board. Infrared cameras are controlled by the same control circuit.
  • the gaze tracking device provided in Embodiment 1 is installed, and the gaze tracking device includes 8 ⁇ infrared lamps, and both are connected to a control circuit, and the 8 ⁇ infrared lamps are mounted on the circular infrared lamps.
  • the control circuit is also arranged on the circular infrared light board, the circular infrared light board is set on a circular eyepiece of the virtual reality glasses, and the other circular eyepiece is set with a set of 8 inches.
  • the circular infrared light plate of the infrared lamp which is also controlled by the above control circuit.
  • the switch of the virtual reality glasses can be first opened, and the line-of-sight tracking device starts to confirm the identity of the user.
  • one of the two eyepieces reaches an effective working brightness, and the infrared camera
  • the image of the user's eyeball is collected, and the image is sent to a processor in the control circuit.
  • the grayscale value of the image during iris recognition is preset in the processor, and the gray value of the eyeball image is acquired when the processor receives the eyeball image. And comparing with the preset gray value of the above image, adjusting the brightness of the infrared light according to the comparison result.
  • the eyeball image acquired by the infrared camera is processed to obtain the eye feature value of the user, and is compared with the pre-stored user identity value of the legal identity.
  • all the other 7 lights are controlled to be lit, and the brightness of the 8 lights is adjusted to a suitable range, and the image of the user's eyeball is obtained in real time through the infrared camera, and the infrared spot reflected by the cornea through the above 8 lights.
  • the location of the user and the user's pupil center position determine the user's line of sight.
  • the application environment is not limited to a virtual reality glasses, and can also be applied to augmented reality devices and other head-mounted devices, such as users performing withdrawals or other services at the ATM. It can be manipulated by a head mounted device including a gaze tracking device.
  • Embodiment 1 The above application environment is only a part of the embodiments, and the device for applying the gaze tracking device mentioned in Embodiment 1 is within the scope of the protection.
  • the infrared light group includes at least two infrared lamps disposed at different positions, and the control circuit can be separately controlled when the line-of-sight tracking device operates on iris recognition and line-of-sight tracking.
  • the number of infrared lamps in the infrared lamp group that achieve the effective working brightness so that the number of infrared lamps that achieve the effective working brightness of the line-of-sight tracking device under these two working states is different, so that the line-of-sight tracking device can
  • the number of infrared lamps that achieve effective working brightness in the infrared light group is respectively controlled, so that the number of infrared lights that effectively work brightness when the line-of-sight tracking device works in iris recognition is small, so that the infrared camera is obtained.
  • the user's eyeball image does not have more infrared spots, so that the user's identity can be identified by acquiring all the eye features. And the number of infrared lamps that make the line-of-sight tracking device work effectively at the time of line-of-sight tracking, so that the infrared light spot on the user's eyeball image obtained by the infrared camera is more, so that the user's line of sight direction is more accurately obtained.
  • connection may also be a detachable connection or an integral connection; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected through an intermediate medium, and may be internal communication between the two elements.
  • connection may also be a detachable connection or an integral connection; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected through an intermediate medium, and may be internal communication between the two elements.
  • the embodiment of the present application provides a gaze tracking device and a head mounted display device, wherein the gaze tracking device includes: an infrared camera, an infrared light group, and a control circuit, the control circuit and the infrared The light group is electrically connected, the infrared light group includes at least two infrared lights disposed at different positions; the infrared camera is configured to collect an image of a user's eyeball when the infrared light is turned on; the control circuit is set to The number of infrared lamps in the infrared light group that reach an effective working brightness is respectively controlled when the line-of-sight tracking device operates on iris recognition and line-of-sight tracking, and the effective working brightness means that the brightness is not less than a threshold brightness.
  • the embodiment of the present application solves the technical problem that the user's line of sight cannot be accurately obtained in the prior art, so that the line-of-sight tracking device can acquire the user identity faster when working in the iris recognition, and more accurately obtain the user's line of sight direction when working in the line of sight tracking.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Optics & Photonics (AREA)
  • Eye Examination Apparatus (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Input (AREA)
  • Image Analysis (AREA)
  • Position Input By Displaying (AREA)

Abstract

一种视线追踪装置及头戴式显示设备，其中，该视线追踪装置包括：红外摄像机（101）、红外灯组（102）和控制电路（103），所述控制电路（103）与所述红外灯组（102）电连接，所述红外灯组（102）包括至少两个设置于不同位置的红外灯（1021）；所述红外摄像机（101），设置为采集在所述红外灯（1021）点亮时用户的眼球图像；所述控制电路（103），设置为在所述视线追踪装置工作于虹膜识别和视线追踪时分别控制所述红外灯组（102）中的达到有效工作亮度的红外灯（1021）个数，所述有效工作亮度指该亮度不小于阈值亮度。该视线追踪装置工作于虹膜识别时能够较快获取用户身份，工作于视线追踪时，更加精确的获取用户视线方向。

Description

视线追踪装置及头戴式显示设备 技术领域
本申请涉及电子设备技术领域，具体而言，涉及一种视线追踪装置及头戴式显示设备。
背景技术
现有的视线追踪装置可以同时具备视线追踪功能和虹膜识别功能，一方面使得视线追踪装置可以获取用户的视线方向，同时可以准确识别用户身份。
发明人在研究中发现，现有技术中在实现视线追踪功能和虹膜识别功能时都是同时使用摄像机在红外补光灯补光的情况下对眼部区域进行拍摄抓取眼部图像，然后依赖不同的图像识别算法判断出眼睛的注视点位置及用户身份信息，在这两个过程中，达到有效工作亮度的红外灯个数不会改变，即红外灯在虹膜识别和视线追踪时，达到有效工作亮度的红外灯的个数均一致。由此在达到有效工作亮度的红外灯个数较多时，造成了视线追踪装置工作于虹膜识别时，由于红外摄像机采集的眼球图像上包括较多的红外光斑，会局部遮挡虹膜图像，造成无法获取全部的眼部特征。或者在红外灯个数较少时，造成了视线追踪装置工作于视线追踪时，由于红外摄像机采集的眼球图像上的红外光斑较少，容易在虹膜区域上采集不到红外光斑，造成视线方向计算不精确或无法计算。
发明内容
有鉴于此，本申请实施例的目的在于提供一种视线追踪装置及头戴式显示设备，以在该视线追踪装置工作于虹膜识别时减少红外灯组中达到有效工作亮度的红外灯个数避免过多红外灯对眼部特征值采集的干扰问题，以及在该视线追踪装置工作于视线追踪时，增加达到有效工作亮度的红外灯的个数使得视线追踪更加精确。
第一方面，本申请实施例提供了一种视线追踪装置，包括红外摄像机、红外灯组 和控制电路，所述控制电路与所述红外灯组电连接，所述红外灯组包括至少两个设置于不同位置的红外灯；
所述红外摄像机，设置为采集在所述红外灯点亮时用户的眼球图像；
所述控制电路，设置为在所述视线追踪装置工作于虹膜识别和视线追踪时分别控制所述红外灯组中的达到有效工作亮度的红外灯个数，所述有效工作亮度指该亮度不小于阈值亮度。
结合第一方面，本申请实施例提供了第一方面的第一种可能的实施方式，所述红外灯组包括设置于第一位置的红外灯组和设置于第二位置的红外灯组，设置于该第一位置的红外灯组工作时发出的红外光不直接照射用户的眼球，设置于该第二位置的红外灯组工作时发出的红外光直接照射用户的眼球；
所述控制电路，设置为在所述视线追踪装置工作于虹膜识别时控制设置于第一位置的红外灯组达到有效工作亮度，在所述视线追踪装置工作于视线追踪时控制设置于第二位置的红外灯组达到有效工作亮度。
结合第一方面，本申请实施例提供了第一方面的第二种可能的实施方式，所述红外摄像机与所述控制电路电连接；
所述红外摄像机，还设置为将所述眼球图像和所述红外光照射所述红外摄像机上形成的虹膜图像传输到所述控制电路；
所述控制电路，还设置为调节达到有效工作亮度的所述红外灯的亮度使得所述眼球图像的灰度值达到预设灰度值。
结合第一方面，本申请实施例提供了第一方面的第三种可能的实施方式，所述红外灯组包括第一红外灯和第二红外灯，所述第一红外灯的数量小于所述第二红外灯的数量；
所述控制电路，设置为在所述视线追踪装置工作于虹膜识别时，控制所述第一红外灯达到有效工作亮度，控制所述第二红外灯的亮度小于所述阈值亮度；以及，设置为在所述视线追踪装置工作于视线追踪时，控制所述第一红外灯的亮度小于所述阈值 亮度，控制所述第二红外灯达到有效工作亮度。
结合第一方面，本申请实施例提供了第一方面的第四种可能的实施方式，所述控制电路与各个所述红外灯分别电连接；
所述控制电路，设置为在所述视线追踪装置工作于虹膜识别时，控制第一设定数量的所述红外灯达到有效工作亮度；以及，设置为在所述视线追踪装置工作于视线追踪时，控制第二设定数量的所述红外灯达到有效工作亮度；所述第一设定数量小于所述第二设定数量。
结合第一方面的第一种可能的实施方式，本申请实施例提供了第一方面的第五种可能的实施方式，所述第一位置的红外灯组包括至少两个红外灯，所述第二位置的红外灯组包括至少3个红外灯；
所述第一位置的红外灯组中的各个红外灯的发光波长小于所述第二位置的红外灯组中的红外灯的发光波长。
结合第一方面的第五种可能的实施方式，本申请实施例提供了第一方面的第六种可能的实施方式，所述第一位置的红外灯组中至少两个红外灯的发光波长不同。
结合第一方面的第六种可能的实施方式，本申请实施例提供了第一方面的第七种可能的实施方式，所述红外摄像机包括第一红外摄像机和第二红外摄像机，所述控制电路还设置为当视线追踪装置工作于虹膜识别时，控制第一红外摄像机工作；当视线追踪装置工作于视线追踪时，控制第二红外摄像机工作。
结合第一方面，本申请实施例提供了第一方面的第八种可能的实施方式，所述控制电路还设置为在所述红外灯达到有效工作亮度时，控制所述红外摄像机开始工作。
第二方面，本申请实施例提供了一种头戴式显示设备，包括第一方面至第一方面的第八种可能的实施方式中的任一种视线追踪装置。
本申请实施例提供的一种视线追踪装置及头戴式显示设备，与现有技术中的视线追踪装置相比，其红外灯组包括至少两个设置于不同位置的红外灯，控制电路在视线追踪装置工作于虹膜识别和视线追踪时能够分别控制所述红外灯组中的达到有效工作 亮度的红外灯个数，使得视线追踪装置在这两种工作状态下，达到有效工作亮度的红外灯的个数不一样，从而使得视线追踪装置可以在工作于虹膜识别和视线追踪时，分别控制红外灯组中达到有效工作亮度的红外灯的个数，使得视线追踪装置工作于虹膜识别时有效工作亮度的红外灯的个数少，使得红外摄像机获得的用户眼球图像上没有较多的红外光斑，从而可以通过获取全部的眼部特征而识别用户身份。以及使得视线追踪装置工作于视线追踪时有效工作亮度的红外灯的个数较多，使得红外摄像机获得的用户眼球图像上的红外光斑较多，从而更加精确的获得用户的视线方向。
为使本申请的上述目的、特征和优点能更明显易懂，下文特举较佳实施例，并配合所附附图，作详细说明如下。
附图说明
为了更清楚地说明本申请实施例的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，应当理解，以下附图仅示出了本申请的某些实施例，因此不应被看作是对范围的限定，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他相关的附图。
图1示出了本申请实施例所提供的一种视线追踪装置的结构示意图；
图2示出了本申请实施例所提供的圆环形红外灯板的实物示意图；
图3示出了本申请实施例所提供的控制电路的电路图；
图4示出了本申请实施例所提供的头戴式虚拟现实眼镜实物示意图。
图标：101-红外摄像机；102-红外灯组；103-控制电路；1021-红外灯；400-圆环形红外灯板；401-眼镜框架；402-镜头。
具体实施方式
为使本申请实施例的目的、技术方案和优点更加清楚，下面将结合本申请实施例中附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。通常在此处附图中描述和示出的本申请实施例的组件可以以各种不同的配置来布置和设计。因此，以下对在附图中 提供的本申请的实施例的详细描述并非旨在限制要求保护的本申请的范围，而是仅仅表示本申请的选定实施例。基于本申请的实施例，本领域技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例，都属于本申请保护的范围。
实施例1
本申请实施例1提供了一种视线追踪装置，如图1所示，包括红外摄像机101，还包括红外灯组102和控制电路103，其中控制电路103和红外灯组102电连接，其中，红外灯组102包括至少两个设置于不同位置的红外灯1021，其中红外摄像机101可以与控制电路103电连接。
红外摄像机101，设置为采集在上述红外灯1021点亮时用户的眼球图像。
当上述视线追踪装置工作时，且所处环境较为黑暗，则红外摄像机101需要在红外灯1021点亮时采集用户的眼球图像。
控制电路103，设置为在视线追踪装置工作于虹膜识别和视线追踪时分别控制红外灯组102中的达到有效工作亮度的红外灯1021的个数，该有效工作亮度指该亮度不小于阈值亮度。
其中达到有效工作亮度的红外灯1021是指该亮度的红外灯直接照射到用户眼球时，红外摄像机101采集到该用户眼球图像时，在虹膜区域采集到的红外光斑会遮挡局部的虹膜图像，使得无法提取全部的眼部特征。如果红外灯1021的亮度极暗，其照射到用户眼球时，红外摄像机提取的眼球图像中的虹膜图像，并没有被局部遮挡，不影响提取全部的眼部特征值，则称为此部分亮度极暗的红外灯1021并没有达到有效工作亮度。为了便于一下叙述方便，将通过达到有效工作亮度的红外灯1021照射形成的红外光斑称为包括红外光斑，将没有达到有效工作亮度的红外灯1021照射眼球图像时形成的红外光斑称为没有形成红外光斑，因为此时的红外光斑在采集眼部特征值时没形成干扰，在视线追踪时，对计算视线方向也没起到作用。
阈值亮度值可以通过多次试验得出，小于阈值亮度的红外灯照射用户眼球时，红外摄像机获取的眼球图像中的虹膜图像上，所成的红外光斑的亮度特别低，或者红外光斑特别小，不影响提取用户的眼部特征值。
一种可选的实施方式，在本申请实施例1提出的技术方案中，红外灯组包括设置于第一位置的红外灯组和设置于第二位置的红外灯组，设置于该第一位置红外灯组工作时发出的红外光工作时发出的红外光不直接照射用户的眼球，设置于该第二位置的红外灯组工作时发出的红外光工作时发出的红外光直接照射用户的眼球。
控制电路，设置为在视线追踪装置工作于虹膜识别时控制设置于第一位置的红外灯组达到有效工作亮度，在视线追踪装置工作于视线追踪时控制设置于第二位置的红外灯组达到有效工作亮度。
其中，设置于第一位置的红外灯工作时不直接照射用户眼球指的是该位置的红外灯在达到有效工作亮度时，没有直接照射人眼，而是照射其他地方，比如用户的眼皮，通过漫反射照射人眼，然后在红外摄像机上成像，红外摄像机获得了用户的眼球图像，且该眼球图像上的虹膜区域无红外光斑。而设置于第二位置的红外灯工作时直接照射用户眼睛，经过眼球的镜面反射，在红外摄像机上成像，红外摄像机获得了用户的眼球图像，且该眼球图像上的虹膜区域有红外光斑。
比如可以设置两个圆环形灯板，一个直径略大于另一个，将直径大的圆环形灯板套设于直径较小的圆环形灯板上，将直径较大的圆环形灯板设置到距离用户眼球距离较远的地方，且其发射的红外光不直接照射用户眼球，而是照射眼球周围的区域，经过该区域的漫反射，一部分漫反射光照射到用户眼球，再在红外摄像机上成像，从而使得红外摄像机获取的眼球图像上没有红外光斑。
在上述情况中，设置于第一位置的红外灯组包括至少两个红外灯，设置于第二位置的红外灯组至少包括3个红外灯，且第一位置的红外灯组中的各个红外灯的发光波长小于第二位置的红外灯组的红外灯的发光波长。
在虹膜识别时，为了提高对用户眼球图像的虹膜识别率，便于提取虹膜特征值，一般采用波长介于760nm～850nm的红外光，而在视线追踪时，为了提高眼球图像中的红外光斑的清晰度，且为了对用户眼球的保护，一般采用波长介于850nm～940nm的红外光。
特别的，在虹膜识别时，由于对虹膜识别率除了受红外光的波长的影响，还受用 户眼睛中虹膜区域的颜色的影响。因此，一种可选的实施方式，在本申请实施例1中提出的技术方案中，设置于第一位置的红外灯组中至少有两个红外灯的发光波长不一样，比如包括3个红外灯，它们发出的红外光的波长是分别是770nm、810nm和840nm。当某一个用户使用该视线追踪装置，且正在进行虹膜识别时，分别让这三种波长的灯有效工作，查看红外摄像机分别获得的三张图像，取最清晰的图像，即灰度值最大的一个，则对应工作的红外灯为该用户最适合的红外灯。
一种可选的实施方式，在本申请实施例1中提出，红外摄像机包括第一红外摄像机和第二红外摄像机，控制电路还设置为当视线追踪装置工作于虹膜识别时，控制第一红外摄像机工作；当视线追踪装置工作于视线追踪时，控制第二红外摄像机工作。第一红外摄像机接收的红外光的波长小于第二红外摄像机接收的红外光的波长。
在视线追踪装置分别工作于虹膜识别时和视线追踪时，控制红外灯组102中达到有效工作亮度的红外灯1021个数不同，使得视线追踪装置工作于虹膜识别时，红外摄像机101采集到用户的眼球图像上不包括红外光斑或者包括很少的红外光斑，这样避免红外摄像机101获取的眼球图像上存在过多的红外光斑，从而无法提取眼球的全部特征值，而无法完成膜识别。同时，使得视线追踪装置工作于视线追踪时，有较多达到有效工作亮度的红外灯1021照射用户眼球的角膜区域，从而使得红外摄像机101获取的眼球图像中，在眼球的瞳孔中心附近分布着较多的红外光斑，通过计算瞳孔中心与各个红外光斑的距离，能够更加精确的确定用户的视线方向。
该视线追踪装置可以设置为虚拟现实设备，也可以设置为增强现实设备或者其头戴式眼控设备，该设备可以兼具对用户的虹膜识别功能和确定用户的视线方向，具体的应用环境在此不做具体限定。
该控制电路103包括处理器，处理器可以通过输出脉冲宽度调制信号调节红外灯组102中的达到有效工作亮度的红外灯1021的个数。
比如，可以通过前期的测试，获取红外灯1021达到有效工作亮度时，通过的最低电流值，则可以通过输出脉冲宽度调制信号调节电流，使得该电流大于或等于上述最低电流值。
在实际操作中，红外灯1021的亮度达到有效工作亮度时，红外摄像机获取的眼球图像中的虹膜图像或者虹膜图像中的红外光斑，并不是较清晰的情况，则可以调节红外灯1021的亮度，使得上述虹膜图像以及红外光斑清晰。
一种可选的实施方式，在本申请实施例1中提出，见图1，红外摄像机101与控制电路103电连接；
其中，红外摄像机101，还设置为将获取的用户的眼球图像传输到控制电路103。
控制电路103，还设置为调节达到有效工作亮度的红外灯1021的亮度使得眼球图像的灰度值达到预设灰度值。
这种情况包括：当视线追踪装置工作于虹膜识别时，控制电路103调节用户眼球图像中的纹理图像的灰度值，使得纹理更加清晰，增加该纹理的识别度，便于很快完成虹膜识别。当视线追踪装置工作于视线追踪时，控制电路103调节获取的用户眼球图像中的瞳孔和红外光斑的灰度值，便于获取较为清晰的瞳孔和红外光斑的图像。
比如，在控制电路103中的处理器中预存眼球图像中的纹理的灰度值为108，预设光斑图像的灰度值为100，或者预存一个灰度值范围。当视线追踪装置工作于虹膜识别时，控制电路103中的处理器可以判断接收到的纹理图像的灰度值是否达到预设的灰度值108，或者是否达到预设灰度值范围，若达到，则不调节此时的红外灯1021的亮度，若未达到，则可以通过输出脉冲宽度调制信号调节红外灯1021的亮度。
当视线追踪装置工作于视线追踪时，控制电路103中的处理器可以判断接收到的眼球图像中的红外光斑的图像的灰度值是否达到预设灰度值100，或者是否达到预存的一个灰度值范围，若达到，则不调节此时的红外灯1021的亮度，若未达到，则可以通过输出脉冲宽度调制信号调节红外灯1021的亮度。
其中，脉冲宽度调制是一种模拟控制方式，其根据相应载荷的变化来调制晶体管基极或MOS管栅极的偏置，来实现晶体管或MOS管导通时间的改变，从而实现开关稳压电源输出的改变。这种方式能使电源的输出电压在工作条件变化时保持恒定，是利用微处理器的数字信号对模拟电路进行控制的一种非常有效的技术。
在此，可以通过调节脉冲宽度调制信号的占空比，来调节输出电流的大小，当然， 通过输出脉冲宽度调制信号来调节红外灯1021的亮度仅仅是一种实施例，并不局限于此种方式。
一种可选的实施方式，在本申请实施例1中提出，红外灯组102包括第一红外灯和第二红外灯，且第一红外灯的数量小于第二红外灯的数量；
控制电路103，设置为在视线追踪装置工作于虹膜识别时，控制第一红外灯达到有效工作亮度，控制第二红外小于阈值亮度；以及，设置为在视线追踪装置工作于视线追踪时，控制第一红外灯小于阈值亮度，控制第二红外灯达到有效工作亮度。
其中控制红外灯的亮度小于阈值亮度，包括将该红外灯直接关闭。
比如，第一红外灯的个数为1个，第二红外灯的个数为8个，当视线追踪装置工作于虹膜识别时，通过控制电路103控制第一红外灯，即1盏红外灯达到有效工作亮度；当视线追踪装置工作于视线追踪时，通过控制电路103控制第二红外灯，即8盏红外灯达到有效工作亮度。
一种可选的实施方式，在本申请实施例1中提出，可以使得第一红外灯和第二红外灯之间并联设置，第二红外灯中的各个红外灯之间串联设置。
另一种可选的实施方式，在本申请实施例1中提出，控制电路103与红外灯组102中的各个红外灯1021电连接；
此时，控制电路103，设置为在视线追踪装置工作于虹膜识别时，控制第一设定数量的红外灯1021达到有效工作亮度；以及设置为在视线追踪装置工作于视线追踪时，控制第二设定数量的红外灯1021达到有效工作亮度；其中，第一设定数量小于第二设定数量。
比如，第一设定数量为1个，第二设定数量为8个，当视线追踪装置工作于虹膜识别时，控制电路103控制红外灯组102中的1盏红外灯1021达到有效工作亮度；当视线追踪装置工作于视线追踪时，控制电路103控制红外灯组102中的8盏红外灯达到有效工作亮度，且这8盏红外灯1021可以包括上述虹膜识别中点亮的那1盏红外灯1021。
一种可选的实施方式，在本申请实施例1中提出，上述红外灯组102中的各个红外灯1021并联连接。
一种可选的实施方式，在本申请实施例1中提出，上述视线追踪装置还包括红外灯板，该红外灯板设置为承载红外灯1021，也可以将控制电路103和红外摄像机101设置在该红外灯板上。
一种可选的实施方式，在本申请实施例1提出的技术方案中，该红外灯板为圆环形红外灯板400，各个红外灯1021均匀的分布在该圆环形红外灯板400上。如图2所示，红外灯组102一共有8盏红外灯1021。该8盏红外灯1021均匀的分布在该圆环形红外灯板400上，围成一个圆，相邻红外灯的间隔相等。此时的控制电路103如图3所示。如图3所示，8盏红外灯1021分别与芯片的引脚11～18一一对应地连接，每个红外灯1021均串联一个上拉电阻R。芯片的引脚11～18输出电平以控制对应连接的红外灯1021。芯片的引脚1～8一一对应地接收控制信号LED1～LED8，每个控制信号控制对应的红外灯1021。
视线追踪装置还包括供电模块，该供电模块设置为给控制电路和红外摄像机供电。
一种可选的实施方式，在本申请实施例1提出的技术方案中，控制电路还设置为在红外灯达到有效工作亮度时，控制红外摄像机开始工作。
为了节约对供电模块的电能消耗，控制电路103还能够控制红外摄像机101的曝光时间与红外灯1021的点亮与熄灭时间。
一种可选的实施方式，在实施例1提出的技术方案中，视线追踪装置工作于视线追踪模式时，红外摄像机曝光时间设置为固定最大值，控制电路通过调节输出的脉冲宽度调制信号将工作于视线追踪的红外灯调整到合适亮度时，控制红外摄像机输出拍摄同步信号，拍摄完成后控制工作于视线追踪的红外灯熄灭。使得工作于视线追踪的红外灯的闪烁频率与红外摄像机拍摄频率相同。
视线追踪装置工作于虹膜识别时，控制电路同样通过调节输出的脉冲宽度调制信号将工作于虹膜识别的红外灯调整到合适亮度时，控制红外摄像机输出拍摄同步信号，拍摄完成后控制工作于虹膜识别的红外灯熄灭。使得工作于虹膜识别的红外灯的闪烁 频率与红外摄像机拍摄频率相同。
另外，在不同的应用环境中，视线追踪装置中可以选择其工作模式，比如，仅仅开启虹膜识别模式，仅仅开启视线追踪模式或者两种工作模式均开启。
比如，视线追踪装置应设置为一种对安全性要求较高的环境，可以使得虹膜识别模式在间隔一定时间时就开启一次。及视线追踪装置在实行视线追踪时，间隔行的开启虹膜识别功能。
一种可选的实施方式，在本申请实施例1中提出的技术方案中，控制电路控制视线追踪与虹膜识别交替循环，控制电路控制红外摄像机在与对应模式的红外灯交替电亮时进行拍摄，这样可以实现第1帧图像为眼控模式下的眼球图像，第2帧为虹膜识别模式下的眼球图像，第3帧为眼控模式下的眼球图像，……依次类推，同时实现眼控与虹膜识别模式，如采集频率为60fps，则奇数帧下的眼球图像为一种工作模式获取的，偶数帧下的眼球图像为另外一种工作模式获取的。此种情况，由于两种工作模式的切换速度极快，所以人眼基本感觉不到工作于两种工作模式下的红外灯的切换。
此外，该视线追踪装置可以安装在一部虚拟现实眼镜中，如图4所示，该虚拟现实眼镜包括眼镜框架401，该眼镜框架包括与用户眼睛对应的镜头402，圆环形红外灯板400的内径大于镜头402的直径，圆环形红外灯板400套设在镜头402上。
实施例2
本申请实施例2提供了一种头戴式显示设备，包括实施例1中的任一种视线追踪装置，还包括头戴式显示设备本体，该本体包括承载装置，该承载装置上包括镜头组和显示屏，镜头组包括左眼镜头或者右眼镜头。
镜头组可以是凸透镜也可以是凹透镜，或者是护眼镜，来适应不同用户的需要，显示屏设置为显示图像。
实施例1中的视线追踪装置，设置为识别用户的身份和确定用户的视线方向，该视线追踪装置中的红外摄像机、红外灯组和控制电路可以安装在一个圆环形红外灯板上，为了节约上述头戴式显示设备的设计空间，该圆环形红外灯板可以设计为内径略大于上述镜头组中的左眼镜头或者右眼镜头的直径。
一种可选的实施方式，有两个圆环形红外灯板，分别套设在上述左眼镜头和右眼镜头上，在圆环形红外灯板上各自均匀设置了8盏红外灯和一个红外摄像机，且均由同一个控制电路进行控制。
下面结合一个实施例进行详细阐述：
在一种虚拟现实眼镜中，安装了实施例1中提供的视线追踪装置，且该视线追踪装置包括8盏红外灯，且均与控制电路连接，这8盏红外灯安装在圆环形红外灯板上，控制电路也设置在圆环形红外灯板上，圆环形红外灯板套设在虚拟现实眼镜的一个圆形目镜上，在另一个圆形目镜上套设了一个装有8盏红外灯的圆环形红外灯板，该8盏红外灯也由上述控制电路进行控制。
用户佩戴该虚拟现实眼镜，首先可以打开该虚拟现实眼镜的开关，则视线追踪装置开始对该用户进行身份确认，在此过程中，两个目镜中各一盏红外灯达到有效工作亮度，红外摄像机采集到用户眼球图像，并将该图像发送到控制电路中的处理器中，处理器内预设了虹膜识别时的图像灰度值，处理器接收到眼球图像时，获取眼球图像的灰度值，并与预设的上述图像灰度值进行比对，根据比对结果调节红外灯的亮度。当亮度合适时，将红外摄像机获取的眼球图像进行处理，获取该用户的眼部特征值，与预存的合法身份的用户特征值进行比对。
若判断该用户为合法使用者，则控制其余7盏灯全部点亮，同时调节8盏灯的亮度到合适范围，通过红外摄像机实时获取用户眼球图像，通过上述8盏灯经角膜反射的红外光斑的位置和用户的瞳孔中心位置确定用户的视线方向。
上述仅仅是视线追踪装置的一种应用环境，其应用环境并不局限于一种虚拟现实眼镜，还可以应用于增强现实设备和其他头戴式设备，比如用户在自主取款机进行取款或者其他业务时，可以通过一种包括视线追踪装置的头戴式设备进行操控。
以上应用环境仅仅是部分实施例，凡是应用实施例1中提到的视线追踪装置的设备，均在本保护范围之内。
基于上述分析可知，与现有技术中的视线追踪装置相比，其红外灯组包括至少两个设置于不同位置的红外灯，控制电路在视线追踪装置工作于虹膜识别和视线追踪时 能够分别控制红所述红外灯组中的达到有效工作亮度的红外灯个数，使得视线追踪装置在这两种工作状态下，达到有效工作亮度的红外灯的个数不一样，从而使得视线追踪装置可以在工作于虹膜识别和视线追踪时，分别控制红外灯组中达到有效工作亮度的红外灯的个数，使得视线追踪装置工作于虹膜识别时有效工作亮度的红外灯的个数少，使得红外摄像机获得的用户眼球图像上没有较多的红外光斑，从而可以通过获取全部的眼部特征而识别用户身份。以及使得视线追踪装置工作于视线追踪时有效工作亮度的红外灯的个数较多，使得红外摄像机获得的用户眼球图像上的红外光斑较多，从而更加精确的获得用户的视线方向。
应注意到：相似的标号和字母在下面的附图中表示类似项，因此，一旦某一项在一个附图中被定义，则在随后的附图中不需要对其进行进一步定义和解释。
在本申请实施例的描述中，需要说明的是，术语“中心”、“上”、“下”、“左”、“右”、“竖直”、“水平”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系，或者是该申请实施例的产品使用时惯常摆放的方位或位置关系，仅是为了便于描述本申请实施例和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本申请的限制。此外，术语“第一”、“第二”、“第三”等仅用于区分描述，而不能理解为指示或暗示相对重要性。
在本申请实施例的描述中，还需要说明的是，除非另有明确的规定和限定，术语“设置”、“安装”、“相连”、“连接”应做广义理解，例如，可以是固定连接，也可以是可拆卸连接，或一体地连接；可以是机械连接，也可以是电连接；可以是直接相连，也可以通过中间媒介间接相连，可以是两个元件内部的连通。对于本领域的普通技术人员而言，可以具体情况理解上述术语在本申请实施例中的具体含义。
最后应说明的是：以上所述实施例，仅为本申请实施例的一种可选的具体实施方式，用以说明本申请实施例的技术方案，而非对其限制，本申请的保护范围并不局限于此，尽管参照前述实施例对本申请实施例进行了详细的说明，本领域的普通技术人员应当理解：任何熟悉本技术领域的技术人员在本申请实施例揭露的技术范围内，其依然可以对前述实施例所记载的技术方案进行修改或可轻易想到变化，或者对其中部分技术特征进行等同替换；而这些修改、变化或者替换，并不使相应技术方案的本质 脱离本申请实施例技术方案的精神和范围。都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应所述以权利要求的保护范围为准。
工业实用性
通过上述描述可知，本申请实施例提供了一种视线追踪装置及头戴式显示设备，其中，该视线追踪装置包括：包括红外摄像机、红外灯组和控制电路，所述控制电路与所述红外灯组电连接，所述红外灯组包括至少两个设置于不同位置的红外灯；所述红外摄像机，设置为采集在所述红外灯点亮时用户的眼球图像；所述控制电路，设置为在所述视线追踪装置工作于虹膜识别和视线追踪时分别控制所述红外灯组中的达到有效工作亮度的红外灯个数，所述有效工作亮度指该亮度不小于阈值亮度。本申请实施例解决了现有技术中无法精确获取用户视线方向的技术问题，使得视线追踪装置工作于虹膜识别时能够较快获取用户身份，工作于视线追踪时，更加精确的获取用户视线方向。

Claims (10)

  1. 一种视线追踪装置，包括红外摄像机、红外灯组和控制电路，所述控制电路与所述红外灯组电连接，所述红外灯组包括至少两个设置于不同位置的红外灯；
    所述红外摄像机，设置为采集在所述红外灯点亮时用户的眼球图像；
    所述控制电路，设置为在所述视线追踪装置工作于虹膜识别和视线追踪时分别控制所述红外灯组中达到有效工作亮度的红外灯个数，所述有效工作亮度指该亮度不小于阈值亮度。
  2. 根据权利要求1所述的视线追踪装置，其中，所述红外灯组包括设置于第一位置的红外灯组和设置于第二位置的红外灯组，设置于该第一位置的红外灯组工作时发出的红外光不直接照射用户的眼球，设置于该第二位置的红外灯组工作时发出的红外光直接照射用户的眼球；
    所述控制电路，设置为在所述视线追踪装置工作于虹膜识别时控制设置于第一位置的红外灯组达到有效工作亮度，在所述视线追踪装置工作于视线追踪时控制设置于第二位置的红外灯组达到有效工作亮度。
  3. 根据权利要求1所述的视线追踪装置，其中，所述红外摄像机与所述控制电路电连接；
    所述红外摄像机，还设置为将所述眼球图像和所述红外光照射所述红外摄像机上形成的虹膜图像传输到所述控制电路；
    所述控制电路，还设置为调节达到有效工作亮度的所述红外灯的亮度使得所述眼球图像的灰度值达到预设灰度值。
  4. 根据权利要求1所述的视线追踪装置，其中，所述红外灯组包括第一红外灯和第二红外灯，所述第一红外灯的数量小于所述第二红外灯的数量；
    所述控制电路，设置为在所述视线追踪装置工作于虹膜识别时，控制所述第一红外灯达到有效工作亮度，控制所述第二红外灯的亮度小于所述阈值亮度；以及，设置为在所述视线追踪装置工作于视线追踪时，控制所述第一红外灯的亮度小于所述阈值亮度，控制所述第二红外灯达到有效工作亮度。
  5. 根据权利要求1所述的视线追踪装置，其中，所述控制电路与各个所述红外灯分别电连接；
    所述控制电路，设置为在所述视线追踪装置工作于虹膜识别时，控制第一设定数量的所述红外灯达到有效工作亮度；以及，设置为在所述视线追踪装置工作于视线追踪时，控制第二设定数量的所述红外灯达到有效工作亮度；所述第一设定数量小于所述第二设定数量。
  6. 根据权利要求2所述的视线追踪装置，其中，所述第一位置的红外灯组包括至少两个红外灯，所述第二位置的红外灯组包括至少3个红外灯；
    所述第一位置的红外灯组中的各个红外灯的发光波长小于所述第二位置的红外灯组中的红外灯的发光波长。
  7. 根据权利要求6所述的视线追踪装置，其中，所述第一位置的红外灯组中至少两个红外灯的发光波长不同。
  8. 根据权利要求7所述视线追踪装置，其中，所述红外摄像机包括第一红外摄像机和第二红外摄像机，所述控制电路还设置为当视线追踪装置工作于虹膜识别时，控制第一红外摄像机工作；当视线追踪装置工作于视线追踪时，控制第二红外摄像机工作。
  9. 根据其权利要求1所述的视线追踪装置，其中，所述控制电路还设置为在所述红外灯达到有效工作亮度时，控制所述红外摄像机开始工作。
  10. 一种头戴式显示设备，包括权利要求1至9任一所述的视线追踪装置。
PCT/CN2018/080811 2017-03-31 2018-03-28 视线追踪装置及头戴式显示设备 WO2018177311A1 (zh)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US16/347,580 US11143869B2 (en) 2017-03-31 2018-03-28 Eye tracking device and head-mounted display device
EP18776251.3A EP3522070A4 (en) 2017-03-31 2018-03-28 LINE OF SIGHT TRACKING DEVICE AND HEAD-MOUNTED DISPLAY DEVICE
JP2019527512A JP6837142B2 (ja) 2017-03-31 2018-03-28 視線追跡装置および頭部装着型表示装置
KR1020197024516A KR102226447B1 (ko) 2017-03-31 2018-03-28 시선 추적 장치 및 헤드 마운티드 디스플레이 기기
CA3042617A CA3042617C (en) 2017-03-31 2018-03-28 Eye tracking device and head-mounted display device
AU2018243092A AU2018243092A1 (en) 2017-03-31 2018-03-28 Line-of-sight tracking device and head-mounted display device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710208503.1A CN106874895B (zh) 2017-03-31 2017-03-31 一种视线追踪装置及头戴式显示设备
CN201710208503.1 2017-03-31

Publications (1)

Publication Number Publication Date
WO2018177311A1 true WO2018177311A1 (zh) 2018-10-04

Family

ID=59160378

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/080811 WO2018177311A1 (zh) 2017-03-31 2018-03-28 视线追踪装置及头戴式显示设备

Country Status (8)

Country Link
US (1) US11143869B2 (zh)
EP (1) EP3522070A4 (zh)
JP (1) JP6837142B2 (zh)
KR (1) KR102226447B1 (zh)
CN (1) CN106874895B (zh)
AU (1) AU2018243092A1 (zh)
CA (1) CA3042617C (zh)
WO (1) WO2018177311A1 (zh)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106874895B (zh) * 2017-03-31 2019-02-05 北京七鑫易维信息技术有限公司 一种视线追踪装置及头戴式显示设备
CN110832435A (zh) * 2017-07-03 2020-02-21 惠普发展公司，有限责任合伙企业 基于眼睛移动旋转微led显示器
CN107463880A (zh) 2017-07-07 2017-12-12 广东欧珀移动通信有限公司 控制方法、电子装置和计算机可读存储介质
CN108111782B (zh) * 2017-12-15 2023-10-17 杭州晨安科技股份有限公司 一种红外目标抗干扰检测方法和用于该方法的检测装置
CN108227226B (zh) * 2017-12-22 2024-01-30 张家港康得新光电材料有限公司 3d显示装置及3d显示方法
CN108089326B (zh) 2018-02-01 2023-12-26 北京七鑫易维信息技术有限公司 一种适配于与眼镜使用的装置
CN108401118B (zh) * 2018-03-05 2020-10-23 北京中科虹霸科技有限公司 控制红外灯开灯时间的虹膜采集装置及方法
TWI642972B (zh) * 2018-03-07 2018-12-01 和碩聯合科技股份有限公司 抬頭顯示系統及其控制方法
CN108681074A (zh) * 2018-07-17 2018-10-19 北京七鑫易维信息技术有限公司 一种头戴式显示设备
TWI726445B (zh) * 2019-04-08 2021-05-01 宏達國際電子股份有限公司 頭戴式顯示裝置
CN110187520A (zh) * 2019-06-19 2019-08-30 蓝润英 摄眼智能单片眼镜、开关夜灯系统和开关空调系统
CN110426845B (zh) * 2019-08-09 2021-03-23 业成科技（成都）有限公司 眼球追踪架构
CN110989166A (zh) * 2019-12-25 2020-04-10 歌尔股份有限公司 一种近眼显示设备的眼球追踪系统及近眼显示设备
KR102305880B1 (ko) * 2020-06-26 2021-09-28 이종우 사용자의 시선 추적 방법 및 사용자의 시선 추적 방법을 실행시키는 프로그램이 기록된 기록 매체
US11990064B2 (en) * 2020-09-07 2024-05-21 Sony Group Corporation Display processing device, display processing method, storage medium, and information processing device
CN113138664A (zh) * 2021-03-30 2021-07-20 青岛小鸟看看科技有限公司 基于光场感知的眼球追踪系统、方法
CN112926523B (zh) * 2021-03-30 2022-07-26 青岛小鸟看看科技有限公司 基于虚拟现实的眼球追踪方法、系统
CN115202043A (zh) * 2021-04-12 2022-10-18 华为技术有限公司 头戴显示设备及其控制方法
CN114035323B (zh) * 2021-10-29 2022-09-23 歌尔光学科技有限公司 一种用于眼球追踪的显示面板及智能眼镜
CN114136209B (zh) * 2021-11-24 2023-11-24 京东方科技集团股份有限公司 一种眼球位置定位电路、方法、基板及虚拟现实穿戴设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202563433U (zh) * 2012-04-10 2012-11-28 南京信息工程大学 基于红外发光管的快速视点跟踪装置
CN105608436A (zh) * 2015-12-23 2016-05-25 联想(北京)有限公司 一种功耗控制方法及电子设备
US20160180801A1 (en) * 2014-12-18 2016-06-23 Samsung Electronics Co., Ltd. Method and apparatus for controlling an electronic device
CN106874895A (zh) * 2017-03-31 2017-06-20 北京七鑫易维信息技术有限公司 一种视线追踪装置及头戴式显示设备
CN206594689U (zh) * 2017-03-31 2017-10-27 北京七鑫易维信息技术有限公司 一种视线追踪装置及头戴式显示设备

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3143491B2 (ja) * 1991-05-27 2001-03-07 キヤノン株式会社 視線検出装置
JP4469476B2 (ja) * 2000-08-09 2010-05-26 パナソニック株式会社 眼位置検出方法および眼位置検出装置
US7986816B1 (en) * 2006-09-27 2011-07-26 University Of Alaska Methods and systems for multiple factor authentication using gaze tracking and iris scanning
JP6175945B2 (ja) * 2013-07-05 2017-08-09 ソニー株式会社 視線検出装置及び視線検出方法
US9430040B2 (en) 2014-01-14 2016-08-30 Microsoft Technology Licensing, Llc Eye gaze detection with multiple light sources and sensors
US20150206173A1 (en) 2014-01-21 2015-07-23 Osterhout Group, Inc. Eye imaging in head worn computing
US9454699B2 (en) 2014-04-29 2016-09-27 Microsoft Technology Licensing, Llc Handling glare in eye tracking
EP3693835A1 (en) 2015-01-07 2020-08-12 Facebook Technologies, LLC Dynamic camera or light operation
WO2016158000A1 (ja) 2015-03-30 2016-10-06 ソニー株式会社 情報処理装置、情報処理方法及び情報処理システム
US20160363995A1 (en) * 2015-06-12 2016-12-15 Seeing Machines Limited Circular light element for illumination of cornea in head mounted eye-tracking

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202563433U (zh) * 2012-04-10 2012-11-28 南京信息工程大学 基于红外发光管的快速视点跟踪装置
US20160180801A1 (en) * 2014-12-18 2016-06-23 Samsung Electronics Co., Ltd. Method and apparatus for controlling an electronic device
CN105608436A (zh) * 2015-12-23 2016-05-25 联想(北京)有限公司 一种功耗控制方法及电子设备
CN106874895A (zh) * 2017-03-31 2017-06-20 北京七鑫易维信息技术有限公司 一种视线追踪装置及头戴式显示设备
CN206594689U (zh) * 2017-03-31 2017-10-27 北京七鑫易维信息技术有限公司 一种视线追踪装置及头戴式显示设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3522070A4 *

Also Published As

Publication number Publication date
EP3522070A1 (en) 2019-08-07
AU2018243092A1 (en) 2019-06-06
KR20190108603A (ko) 2019-09-24
CN106874895B (zh) 2019-02-05
JP6837142B2 (ja) 2021-03-03
US20200012105A1 (en) 2020-01-09
CN106874895A (zh) 2017-06-20
JP2019537149A (ja) 2019-12-19
CA3042617C (en) 2021-06-08
KR102226447B1 (ko) 2021-03-12
EP3522070A4 (en) 2020-06-24
CA3042617A1 (en) 2019-05-02
US11143869B2 (en) 2021-10-12

Similar Documents

Publication Publication Date Title
WO2018177311A1 (zh) 视线追踪装置及头戴式显示设备
JP6208901B2 (ja) 目追跡装置動作方法及び能動的電力管理を行う目追跡装置
US20210325649A1 (en) System and method to automatically adjust illumination during a microsurgical procedure
US10437327B2 (en) Eye tracking device and method for operating an eye tracking device
JP4808420B2 (ja) 目の検出を利用した電子装置の制御および電力管理
EP3473003B1 (en) Wide field fundus camera with auto-montage at a single alignment
JP2016539717A (ja) 目追跡のロバスト性を改善するアクティブ照明制御を行う目追跡装置動作方法及び目追跡装置
JP2023550538A (ja) 瞳孔検出および視線追跡のためのイベントカメラシステム
TW201416908A (zh) 瞳孔追蹤裝置
JP5998863B2 (ja) 視線検出装置および視線検出方法
US20220338733A1 (en) External alignment indication/guidance system for retinal camera
JP6957048B2 (ja) 眼部画像処理装置
CN206594689U (zh) 一种视线追踪装置及头戴式显示设备
JP2016087291A (ja) 瞳孔・視線計測装置および照明システム
WO2020032128A1 (ja) 眼科撮影装置
JP6687195B2 (ja) 眼部画像処理装置
EP3481261B1 (en) An apparatus for providing semantic information and a method of operating the same
PL229076B1 (pl) Układ do pomiaru położenia punktu fiksacji wzroku użytkownika na powierzchni ekranu komputerowego
WO2021251146A1 (ja) 瞳孔検出装置
US20210076926A1 (en) Retinal camera with dynamic illuminator for expanding eyebox
US20240115345A1 (en) Illumination system for surgical microscope with tunable coaxial and oblique beams

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18776251

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019527512

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2018776251

Country of ref document: EP

Effective date: 20190429

ENP Entry into the national phase

Ref document number: 2018243092

Country of ref document: AU

Date of ref document: 20180328

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20197024516

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE