WO2023246816A1 - 一种眼球追踪光学系统及头戴式设备 - Google Patents

一种眼球追踪光学系统及头戴式设备 Download PDF

Info

Publication number
WO2023246816A1
WO2023246816A1 PCT/CN2023/101522 CN2023101522W WO2023246816A1 WO 2023246816 A1 WO2023246816 A1 WO 2023246816A1 CN 2023101522 W CN2023101522 W CN 2023101522W WO 2023246816 A1 WO2023246816 A1 WO 2023246816A1
Authority
WO
WIPO (PCT)
Prior art keywords
module
light
image acquisition
optical system
eyepiece
Prior art date
Application number
PCT/CN2023/101522
Other languages
English (en)
French (fr)
Inventor
孟驰骅
黄通兵
Original Assignee
北京七鑫易维信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京七鑫易维信息技术有限公司 filed Critical 北京七鑫易维信息技术有限公司
Publication of WO2023246816A1 publication Critical patent/WO2023246816A1/zh

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems

Definitions

  • the present disclosure relates to the field of eye tracking technology, and in particular, to an eye tracking optical system and a head-mounted device.
  • Eye tracking technology can be implemented using optical recording methods.
  • the principle of the optical recording method is to use an infrared camera to record the subject's eye movements, that is, to obtain eye images that can reflect eye movements, and to extract eye features from the acquired eye images to establish a line of sight estimation model.
  • the eye features may include: pupil position, pupil shape, iris position, iris shape, eyelid position, eye canthus position, light spot position (or Purchin spot), etc.
  • Optical recording methods include the pupillary-corneal reflex method.
  • the principle of the pupil-cornea reflection method is that a near-infrared light source is illuminated at the eye, and the eye is photographed by an infrared camera. At the same time, the reflection point of the light source on the cornea, which is the light spot, is captured, thereby obtaining an eye image with the light spot.
  • FIG 1 is a schematic structural diagram of an eye tracking optical system provided by the prior art.
  • the camera 4 is usually placed on the side of the fixed lens 1 of the eye tracking optical system near the user's eye 5.
  • the structural design of the camera has a large horizontal angle ⁇ between the axis of the photosensitive surface. This situation will directly affect the image quality and limit the accuracy of the algorithm.
  • the present disclosure provides an eye tracking optical system and a head-mounted device.
  • the small horizontal angle between the camera axis increases the incident field of view of light and improves the accuracy of the image acquisition algorithm and the quality of the camera image.
  • the present disclosure provides an eye tracking optical system, including a light source module, an eyepiece module, a first optical path adjustment module and an image acquisition module;
  • the light source module is located at the edge of the eyepiece module close to the user's eyeball.
  • the light source module is configured to emit light of a preset wavelength to the user's eyeball; the light of the preset wavelength is reflected by the user's eyeball to form Reflect light;
  • the eyepiece module and the first light path adjustment module are located on the side away from the user's eyeball in sequence, and the image acquisition module is located on one edge of the gap between the eyepiece module and the first light path adjustment module;
  • the reflected light at least passes through the eyepiece module and then enters the image acquisition module.
  • the image acquisition module is configured to generate an image of the user's eyeball based on the received reflected light.
  • the photosensitive surface of the image acquisition module faces the user's eyeball, and the reflected light enters the image acquisition module after passing through the eyepiece module.
  • the eye tracking optical system further includes a dimming module; the dimming module and the image acquisition module are fixedly arranged;
  • the dimming module is configured to adjust the propagation direction of the reflected light; the reflected light passes through the eyepiece module and is reflected by the dimming module before entering the image acquisition module.
  • the dimming module includes a reflective prism
  • the reflected light enters the image acquisition module after being reflected by the reflective surface of the reflective prism.
  • the dimming module includes an infrared cutoff piece configured to reflect infrared band light emitted from the array infrared band light source to the image acquisition module.
  • the eyepiece module includes a first fixed lens
  • the first optical path adjustment module includes a second fixed lens and an adjustable lens
  • the eye tracking optical system further includes a display screen
  • the eye tracking optical system includes a light source module, an eyepiece module, a first optical path adjustment module and an image acquisition module; the light source module is located at the edge of the eyepiece module close to the user's eyeball, and the light source module is configured to emit light of a preset wavelength to The user's eyeball; the light of the preset wavelength is reflected by the user's eyeball to form reflected light; the eyepiece module and the first optical path adjustment module are located on the side away from the user's eyeball in turn, and the image acquisition module is moved from the edge of the eyepiece module closer to the user's eyeball The edge of the eyepiece module away from the user's eyeball is set inside the system; the reflected light at least passes through the eyepiece module and then enters the image acquisition module to reduce the horizontal angle between the axis of the camera's photosensitive surface and increase the incident field of view of light. angle, the image acquisition module is set to generate an image of the user's eyeball based on the received reflected light.
  • Figure 1 is a schematic structural diagram of an eye tracking optical system provided by the prior art
  • Figure 4 is a schematic structural diagram of a dimming module and an image acquisition module provided by the present disclosure
  • Figure 5 is a schematic structural diagram of another dimming module and image acquisition module provided by the present disclosure.
  • FIG. 2 is a schematic structural diagram of an eye-tracking optical system provided by the present disclosure
  • FIG. 3 is a schematic structural diagram of another eye-tracking optical system provided by the present disclosure.
  • the eye tracking optical system provided by the present disclosure includes a light source module 1, an eyepiece module 2, a first optical path adjustment module 3 and an image acquisition module 4; the light source module 1 is located in the eyepiece module 2 close to the user On the edge of one side of the eyeball 5, the light source module 1 is configured to emit light S1 of a preset wavelength to the user's eyeball 5; the light of the preset wavelength is reflected by the user's eyeball 5 to form a reflected light S2; the eyepiece module 2 and the first optical path adjustment module 3 Located on the side away from the user's eyeball 5 in turn, the image acquisition module 4 is located between the eyepiece module 2 and the first optical path adjustment One edge of the gap in the module 3; the reflected light S2 at least passes through the eyepiece module 2 and then enters the image acquisition
  • the eye tracking optical system provided by the present disclosure also includes a mounting frame (not shown in the figure), a light source module 1, an eyepiece module 2, a first light path adjustment module 3 and an image acquisition module. 4 can be fixedly arranged in the installation frame, and the eyepiece module 2 can include at least one fixed lens to protect other components and focus light;
  • the image acquisition module 4 includes at least one image acquisition device, such as a camera, etc., configured to image Imaging;
  • the light source module 1 includes at least one luminous light source that can emit light S1 of a preset wavelength acceptable to the eyes, such as light in the visible light band, infrared band, etc.
  • the photosensitive surface of the image acquisition module 4 faces the user's eyeball 5 , and the reflected light S2 enters the image acquisition module 4 after passing through the eyepiece module 2 .
  • the image acquisition module 4 is moved from the edge of the eyepiece module 2 close to the user's eyeball 5 to the edge of the eyepiece module 2 away from the user's eyeball 5, and the photosensitive surface of the image acquisition module 4 is directed toward the user's eyeball 5.
  • the horizontal angle between the axis of the photosensitive surface of the camera is b, b ⁇ ⁇ , which reduces the horizontal angle between the axis of the photosensitive surface of the camera.
  • the reflected light S2 passes through the eyepiece module 2 and enters the image acquisition module 4, so that the image acquisition module 4
  • the photosensitive surface can receive as much reflected light S2 reflected by the user's eyeball 5 as possible, which can improve the light reception rate of the image acquisition module 4 and increase the brightness of the image imaging.
  • FIG. 4 is a schematic structural diagram of a light-adjusting module and an image acquisition module provided by the present disclosure
  • FIG. 5 is a schematic structural diagram of another light-adjusting module and an image acquisition module provided by the present disclosure.
  • the eye tracking optical system also includes a dimming module 6 ; the dimming module 6 and the image acquisition module 4 are fixedly arranged; the dimming module 6 is set to Adjust the propagation direction of the reflected light S2; the reflected light S2 passes through the eyepiece module 2 and is reflected by the dimming module 6 before entering the image acquisition module 4.
  • the dimming module 6 can also be fixedly installed at the front end of the photosensitive surface of the image acquisition module 4.
  • the dimming module 6 has a reflection effect on the preset wavelength light emitted from the light source module 1, and can adjust the propagation direction of the reflected light S2, as shown in the figure.
  • the built-in shooting method of the photosensitive surface of the image acquisition module 4 is implemented, that is, the photosensitive surface is no longer facing the user's eyeball 5.
  • the horizontal angle between the axis of the photosensitive surface of the camera is c, c ⁇ ⁇ , and decreases
  • the horizontal angle between the axis of the camera's photosensitive surface is increased, and the incident field of view angle of light is increased, thereby improving the accuracy of the image acquisition algorithm and the image quality of the camera.
  • the dimming module 6 includes a reflective prism 61 , and the reflected light S2 enters the image acquisition module 4 after being reflected by the reflective surface of the reflective prism 61 .
  • the reflective prism 61 utilizes the law of reflection and refraction of light. When light is reflected in the same medium, its reflection angle is equal to the incident angle; when light is incident from one medium to another medium perpendicular to two medium planes, it does not Refraction occurs.
  • the reflective prism 61 has a reflective surface. Further, by setting the angle between the reflective surface of the reflective prism 61 and the photosensitive surface of the image acquisition module 4, it is ensured that more reflected light S2 passing through the eyepiece module 2 enters the image acquisition module after being reflected by the dimming module 6. 4. This structure can flexibly adjust the position of the image acquisition module 4, further compress the volume of the system, and meet the application requirements of eye tracking and iris recognition of compact display light machines.
  • the reflective surface of the reflective prism includes an anti-reflection film.
  • Reflective film and anti-reflective film include full-band reflective film to improve the reflection efficiency of reflected light, allowing more reflected light to enter the image acquisition module and improve the imaging brightness of the eyeball.
  • the light source module 1 includes an array of infrared band light sources configured to emit array infrared band light.
  • the array infrared band light source is an array group composed of several infrared light sources (700nm ⁇ 1100nm or specific band), and emits the infrared band light of the array.
  • the use of array infrared band light sources can provide uniform light spots, so that the light energy received by the user's eyes is uniform. After the light is reflected by the user's eyes, the imaging in the image acquisition module 4 is uniform, reducing the problem of blurred imaging edges.
  • the dimming module 6 includes an infrared cutoff piece 62 configured to reflect the infrared band light emitted from the array infrared band light source to the image acquisition module 4 .
  • Infrared cutoff film 62 refers to a lens that reflects light in the infrared band and transmits light of other wavelengths. It uses precision optical coating technology to alternately coat optical films with high and low refractive index on the optical glass to achieve infrared (700nm ⁇ 1100nm) cutoff.
  • the optical filter adopts the infrared cutoff piece 62, which can make more light emitted by the array infrared band light source be reflected to the image acquisition module 4, improve the light utilization rate, and help improve the accuracy of the image acquisition algorithm and the image quality of the camera.
  • the eye tracking optical system also includes a display screen 7; the display screen 7 is located on the side of the eye tracking optical system away from the user's eyeball 5, and the display screen 7 7 is a multi-dimensional display screen, configured to display multi-dimensional images.
  • the display screen 7 can adopt an organic light emitting diode display (OLED) display screen, a light emitting diode (Light Emitting Diode Display, LED) display screen, or a micro light emitting diode (Micro Light Emitting Diode Display, Micro LED).
  • OLED organic light emitting diode display
  • LED Light Emitting Diode Display
  • Micro LED Micro Light Emitting Diode Display
  • Display panels, etc. display color or black and white images; set the display screen 7 to be located on the side of the first light path adjustment module 3 away from the user's eyes,
  • the multi-dimensional image emitted from the display screen 7 passes through the first optical path adjustment module 3 and the eyepiece module 2 in sequence, and then reaches the user's eyes for imaging.
  • the eyepiece module 2 includes a first fixed lens
  • the first optical path adjustment module 3 includes a second fixed lens 31 and an adjustable lens 32
  • the optical axis of a fixed lens, the optical axis of the second fixed lens 31 and the optical axis of the adjustable lens 32 are located on the same straight line L; the adjustable lens 32 can move along the direction of the straight line L.
  • the optical axis of the first fixed lens, the optical axis of the second fixed lens 31 and the optical axis of the adjustable lens 32 are located on the same straight line L, and the adjustable lens 32 is close to the display
  • the lens on one side of the screen 7 can move along the optical axis straight line L direction.
  • the adjustable lens 32 is located in the compact display light machine and is close to the screen.
  • the eye tracking optical system improves the problem of the horizontal angle of the camera axis becoming larger by changing the camera position layout and adding optical devices, and can reduce the horizontal angle of the camera axis and increase the utilization of light. , improve the accuracy of the image acquisition algorithm and the quality of the camera image; changing the camera to a built-in shooting method can further compress the eye tracking optical system and meet the structural design requirements of eye tracking and iris recognition technology of compact display light machines.
  • the present disclosure provides a head-mounted device, including a head-mounted device and the eye-tracking optical system provided in the above embodiments, which can be configured for user-worn eye tracking and iris recognition applications.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

一种眼球追踪光学系统及头戴式设备，系统包括光源模块（1）、目镜模块（2）、第一光路调节模块（3）和图像采集模块（4）；光源模块（1）位于目镜模块（2）靠近用户眼球（5）的一侧边缘，光源模块（1）设置为发射预设波长的光线（S1）至用户眼球（5）；预设波长的光线（S1）经用户眼球（5）反射后形成反射光线（S2）；目镜模块（2）和第一光路调节模块（3）依次位于远离用户眼球（5）的一侧；反射光线（S2）至少透过目镜模块（2）后进入图像采集模块（4），图像采集模块（4）设置为根据接收到的反射光线（S2）生成用户眼球（5）的图像，可以减小摄像头轴线水平夹角，提高图像采集算法精度和摄像头图像质量，结构紧凑。

Description

一种眼球追踪光学系统及头戴式设备
本申请要求于2022年06月21日提交中国专利局、申请号为202210705618.2、申请名称“一种眼球追踪光学系统及头戴式设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本公开涉及眼球追踪技术领域，尤其涉及一种眼球追踪光学系统及头戴式设备。
背景技术
眼球追踪技术可以采用光学记录法实现。光学记录法的原理是：利用红外相机记录被测试者的眼睛运动情况，即获取能够反映眼睛运动的眼部图像，从获取到的眼部图像中提取眼部特征，以建立视线的估计模型。其中，眼部特征可以包括：瞳孔位置、瞳孔形状、虹膜位置、虹膜形状、眼皮位置、眼角位置、光斑位置(或者普尔钦斑)等。光学记录法包括瞳孔-角膜反射法。瞳孔-角膜反射法的原理是，近红外光源照向眼睛，由红外相机对眼部进行拍摄，同时拍摄到光源在角膜上的反射点即光斑，由此获取到带有光斑的眼部图像。
因目前虚拟现实(Virtual Reality，VR)类头盔趋于厚度薄、可折叠的方向发展和设计，故大多会基于紧凑式显示光机进行产品化开发。图1是现有技术提供的一种眼球追踪光学系统的结构示意图，结合图1所示，现有技术中通常将摄像头4设置在眼球追踪光学系统的固定透镜1近用户眼睛5的一侧，该结构设计摄像头的感光面的轴线水平夹角α较大，这种情况将直接影响图像质量而造成算法精度受限。
发明内容
本公开提供一种眼球追踪光学系统及头戴式设备，通过将摄像头器件由目镜模块靠近用户眼球一侧的边缘移动到目镜远离用户眼球一侧的边缘，即设置在光学系统目镜后面，以减小摄像头轴线水平夹角，增大光线入射视场角，提高图像采集算法精度和摄像头图像质。
本公开提供了一种眼球追踪光学系统，包括光源模块、目镜模块、第一光路调节模块和图像采集模块；
所述光源模块位于所述目镜模块靠近用户眼球一侧的边缘，所述光源模块设置为发射预设波长的光线至所述用户眼球；所述预设波长的光线经所述用户眼球反射后形成反射光线；
所述目镜模块和所述第一光路调节模块依次位于远离所述用户眼球的一侧，所述图像采集模块位于所述目镜模块和所述第一光路调节模块间隙的一侧边缘；
所述反射光线至少透过所述目镜模块后进入图像采集模块，所述图像采集模块设置为根据接收到的所述反射光线生成所述用户眼球的图像。
可选地，所述图像采集模块的感光面朝向所述用户眼球，所述反射光线透过所述目镜模块后进入图像采集模块。
可选地，所述眼球追踪光学系统还包括调光模块；所述调光模块和所述图像采集模块固定设置；
所述调光模块设置为调节所述反射光线的传播方向；所述反射光线穿过所述目镜模块经所述调光模块反射后进入所述图像采集模块。
可选地，所述调光模块包括反射棱镜，
所述反射光线经所述反射棱镜的反射面反射后进入所述图像采集模块。
可选地，所述反射棱镜的反射面包括增反膜。
可选地，所述光源模块包括阵列红外波段光源，设置为出射阵列红外波段光线。
可选地，所述调光模块包括红外截止片，设置为反射所述阵列红外波段光源出射的红外波段光线到所述图像采集模块。
可选地，所述目镜模块包括第一固定透镜，所述第一光路调节模块包括第二固定透镜和可调透镜；
所述第一固定透镜的光轴、所述第二固定透镜的光轴和所述可调透镜的光轴位于同一直线上；所述可调透镜可沿所述直线的方向移动。
可选地，所述眼球追踪光学系统还包括显示屏；
所述显示屏位于所述第一光路调节模块远离所述用户眼球的一侧，所述显示屏为多维度显示屏，设置为显示多维度图像。
第二方面，本公开还提供了一种头戴式设备，包括头戴装置和上述的眼球追踪光学系统。
本公开提供的眼球追踪光学系统，包括光源模块、目镜模块、第一光路调节模块和图像采集模块；光源模块位于目镜模块靠近用户眼球的一侧边缘，光源模块设置为发射预设波长的光线至用户眼球；预设波长的光线经用户眼球反射后形成反射光线；目镜模块和第一光路调节模块依次位于远离用户眼球的一侧，通过将图像采集模块由目镜模块靠近用户眼球的一侧边缘移动到目镜模块远离用户眼球一侧的边缘，设置在系统内部；反射光线至少透过目镜模块后进入图像采集模块，以减小摄像头的感光面的轴线水平夹角，增大光线入射视场 角，图像采集模块设置为根据接收到的反射光线生成用户眼球的图像，采用该结构设置，可以提高图像采集算法精度和摄像头图像质。
附图说明
图1是现有技术提供的一种眼球追踪光学系统的结构示意图；
图2是本公开提供的一种眼球追踪光学系统的结构示意图；
图3是本公开提供的另一种眼球追踪光学系统的结构示意图；
图4是本公开提供的一种调光模块和图像采集模块的结构示意图；
图5是本公开提供的另一种调光模块和图像采集模块的结构示意图。
具体实施方式
下面结合附图和实施例对本公开作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本公开，而非对本公开的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本公开相关的部分而非全部结构。
图2是本公开提供的一种眼球追踪光学系统的结构示意图；图3是本公开提供的另一种眼球追踪光学系统的结构示意图。结合图2和图3所示，本公开提供的眼球追踪光学系统，该系统包括光源模块1、目镜模块2、第一光路调节模块3和图像采集模块4；光源模块1位于目镜模块2靠近用户眼球5一侧的边缘，光源模块1设置为发射预设波长的光线S1至用户眼球5；预设波长的光线经用户眼球5反射后形成反射光线S2；目镜模块2和第一光路调节模块3依次位于远离用户眼球5的一侧，图像采集模块4位于目镜模块2和第一光路调 节模块3间隙的一侧边缘；反射光线S2至少透过目镜模块2后进入图像采集模块4，图像采集模块4设置为根据接收到的反射光线S2生成用户眼球5的图像。
具体的，结合图2和图3所示，本公开提供的眼球追踪光学系还包括安装框架(图中未示出)，光源模块1、目镜模块2、第一光路调节模块3和图像采集模块4可以固定设置在安装框架内，目镜模块2可以包括至少一个固定设置的透镜，起到保护其他组件和聚焦光线的作用；图像采集模块4包括至少一个图像采集设备，如摄像头等，设置为图像成像；光源模块1包括至少一个发光光源，可以发射眼睛可接受的预设波长的光线S1，如可见光波段、红外波段的光线等。设置光源模块1位于目镜模块2靠近用户眼球5的一侧边缘，图像采集模块4位于目镜模块2和第一光路调节模块3间隙的一侧边缘，即位于目镜模块2和第一光路调节模块3之间，采用内置摄像头拍摄的方式，此时摄像头的感光面的轴线水平夹角为b或c，b＜α，c＜α，通过将图像采集模块4由目镜模块2靠近用户眼球5的一侧边缘移动到目镜模块2远离用户眼球5一侧的边缘，采用外置摄像头拍摄的方式，可以减小摄像头的感光面的轴线水平夹角，增大光线入射视场角，进而提高图像采集的算法精度和摄像头图像质；还可以节省出摄像机的位置，压缩眼球追踪光学系的体积，满足紧凑式显示光机的眼球追踪和虹膜识别技术的结构设计要求。具体的，在眼球追踪光学系统工作时，光源模块1出射的光线照射用户眼球5，在用户眼球5的角膜上形成的反射点称为光斑(也称为普尔钦斑)，光线经用户眼球5反射后形成反射光线S2进入图像模块的感光面，图像采集模块采集眼睛光斑的位置以及瞳孔的位置并进行拍摄，由此获得带有光斑的眼部图像；在眼球转动时，瞳孔中心与光斑的相对位置关系发生相应变化，图像模块采集到的带有光斑的若干眼部图像反映出相应 的位置变化关系，根据所述位置变化关系即可进行视线/注视点估计，完成虹膜成像和眼球追踪。
综上，本公开提供的眼球追踪光学系统包括光源模块、目镜模块、第一光路调节模块和图像采集模块；光源模块位于目镜模块靠近用户眼球的一侧边缘，减小摄像头的感光面的轴线水平夹角，光源模块设置为发射预设波长的光线至用户眼球；预设波长的光线经用户眼球反射后形成反射光线；目镜模块和第一光路调节模块依次位于远离用户眼球的一侧，通过将摄像头模块由目镜模块靠近用户眼球的一侧边缘移动到目镜模块远离用户眼球一侧的边缘，设置在系统内部；反射光线至少透过目镜模块后进入图像采集模块，以减小摄像头轴线水平夹角，增大光线入射视场角，图像采集模块设置为根据接收到的反射光线生成用户眼球的图像，采用该结构设置，可以提高图像采集算法精度和摄像头图像质；还可以节省出摄像机的位置，进一步压缩眼球追踪光学系的体积，满足紧凑式显示光机的眼球追踪和虹膜识别技术的结构设计要求。
作为一种可行的实施方式，继续参考图2所示，可选地，图像采集模块4的感光面朝向用户眼球5，反射光线S2透过目镜模块2后进入图像采集模块4。
具体的，将图像采集模块4由目镜模块2靠近用户眼球5的一侧边缘移动到目镜模块2远离用户眼球5一侧的边缘，并且将图像采集模块4的感光面朝向用户眼球5，此时摄像头的感光面的轴线水平夹角为b，b＜α，减小了摄像头的感光面的轴线水平夹角，反射光线S2透过目镜模块2后进入图像采集模块4后，使得图像采集模块4的感光面尽可能多的接收用户眼球5反射的反射光线S2，可以提高图像采集模块4的光接收率，增大图像成像的亮度。
图4是本公开提供的一种调光模块和图像采集模块的结构示意图；图5是本公开提供的另一种调光模块和图像采集模块的结构示意图。作为一种可行的实施方式，结合图3-图5所示，可选地，眼球追踪光学系统还包括调光模块6；调光模块6和图像采集模块4固定设置；调光模块6设置为调节反射光线S2的传播方向；反射光线S2穿过目镜模块2经调光模块6反射后进入图像采集模块4。
具体的，还可以在图像采集模块4感光面的前端固定设置调光模块6，调光模块6针对光源模块1出射的预设波长光线具有反射作用，可以调整反射光线S2的传播方向，如图4和图5所示，实现图像采集模块4的感光面内置拍摄的方式，即感光面不再朝向用户眼球5，此时摄像头的感光面的轴线水平夹角为c，c＜α，减小了摄像头的感光面的轴线水平夹角，增大光线入射视场角，进而提高图像采集算法精度和摄像头图像质。
可选地，结合图3和图4所示，调光模块6包括反射棱镜61，反射光线S2经反射棱镜61的反射面反射后进入图像采集模块4。
具体的，反射棱镜61利用光的反射定律和折射定律，光在相同介质中发生反射时，其反射角和入射角相等；光由一种介质垂直两介质平面入射到另一种介质时，不会发生折射。反射棱镜61具有反射面，进一步通过设置反射棱镜61的反射面与图像采集模块4感光面的夹角，保证穿过目镜模块2的更多反射光线S2经调光模块6反射后进入图像采集模块4，该结构可以灵活调整图像采集模块4的位置，进一步压缩系统的体积，满足紧凑式显示光机的眼球追踪和虹膜识别的应用要求。
可选地，反射棱镜的反射面包括增反膜。通过在反射棱镜的反射面增镀增 反膜，增反膜包括全波段反射膜，以提高反射光线的反射效率，使得更多反射光线进入图像采集模块，提高眼球的成像亮度。
在上述实施例的基础上，继续参照图2和图3所示，可选地，光源模块1包括阵列红外波段光源，设置为出射阵列红外波段光线。
具体的，阵列红外波段光源是由若干颗红外发光源(700nm～1100nm或特定波段)组成的阵列组，出射阵列的红外波段光线。采用阵列红外波段光源可提供光斑均匀的光线，使得用户眼睛接收的光线能量均匀，光线经用户眼睛反射后在图像采集模块4的成像均匀，减小成像边缘模糊的问题。
在上述实施例的基础上，继续参照图3和图5所示，可选地，调光模块6包括红外截止片62，设置为反射阵列红外波段光源出射的红外波段光线到图像采集模块4。红外截止片62指的是红外波段的光线被反射，其他波长的光线透过的镜片，利用精密光学镀膜技术在光学玻璃上交替镀上高低折射率的光学膜，实现红外(700nm～1100nm)截止的光学滤光片，采用红外截止片62，可以使阵列红外波段光源出射的光线更多的被反射到图像采集模块4，提高光线利用率，有利于提高图像采集算法精度和摄像头图像质。
在上述实施例的基础上，继续参照图2和图3所示，可选地，眼球追踪光学系统还包括显示屏7；显示屏7位于眼球追踪光学系统远离用户眼球5的一侧，显示屏7为多维度显示屏，设置为显示多维度图像。
具体的，显示屏7可以采用有机发光(Organic Light Emitting Diode Display，OLED)显示面屏、发光二极管(Light Emitting Diode Display，LED)显示面屏、微发光二极管(Micro Light Emitting Diode Display，Micro LED)显示面屏等，显示彩色或黑白画面；设置显示屏7位于第一光路调节模块3远离用户眼睛的一侧， 显示屏7出射的多维度图像依次经过第一光路调节模块3、目镜模块2后到达用户眼睛成像。
在上述实施例的基础上，继续参照图2和图3所示，可选地，目镜模块2包括第一固定透镜，第一光路调节模块3包括第二固定透镜31和可调透镜32；第一固定透镜的光轴、第二固定透镜31的光轴和可调透镜32的光轴位于同一直线L上；可调透镜32可沿直线L的方向移动。
具体的，继续参照图2和图3所示，第一固定透镜的光轴、第二固定透镜31的光轴和可调透镜32的光轴位于同一直线L上，可调透镜32为靠近显示屏7一侧的镜片，可沿光轴直线L方向移动，可调透镜32位于紧凑式显示光机中靠近屏幕的镜片，通过调整其相对于第二固定透镜31和显示屏7之间的距离大小，达到适配不同屈光度数的效果，满足不同用户眼睛视力的佩戴要求，使其均可以清晰看到显示屏的多维度画面。
需要说明的是，图1中的其他附图标记，请参照图2和图3所示，这里不再做一一解释说明。
综上，本公开提供的眼球追踪光学系统，通过改变摄像头位置布局和增加光学器件的方法来改善摄像头轴线水平夹角变大的问题，可减小摄像头轴线水平夹角，增大光线的利用率，提高图像采集算法精度和摄像头图像质量；将摄像头改为内置拍摄的方式，还可以进一步压缩眼球追踪光学系统，满足紧凑式显示光机的眼球追踪和虹膜识别技术的结构设计要求。
基于同一个发明构思，本公开提供了一种头戴式设备，包括头戴装置和上述实施例提供的眼球追踪光学系统，可设置为用户穿戴式的眼球追踪和虹膜识别的应用中。
注意，上述仅为本公开的较佳实施例及所运用技术原理。本领域技术人员会理解，本公开不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整、相互组合和替代而不会脱离本公开的保护范围。因此，虽然通过以上实施例对本公开进行了较为详细的说明，但是本公开不仅仅限于以上实施例，基于不脱离本公开构思，还可以包括更多其他等效实施例，而本公开的范围由所附的权利要求范围决定。

Claims (10)

  1. 一种眼球追踪光学系统，包括光源模块、目镜模块、第一光路调节模块和图像采集模块；
    所述光源模块位于所述目镜模块靠近用户眼球一侧的边缘，所述光源模块设置为发射预设波长的光线至所述用户眼球；所述预设波长的光线经所述用户眼球反射后形成反射光线；
    所述目镜模块和所述第一光路调节模块依次位于远离所述用户眼球的一侧，所述图像采集模块位于所述目镜模块和所述第一光路调节模块间隙的一侧边缘；
    所述反射光线至少透过所述目镜模块后进入图像采集模块，所述图像采集模块设置为生成所述用户眼球的图像。
  2. 根据权利要求1所述的眼球追踪光学系统，其中，所述图像采集模块的感光面朝向所述用户眼球，所述反射光线透过所述目镜模块后进入图像采集模块。
  3. 根据权利要求1所述的眼球追踪光学系统，其中，还包括调光模块；所述调光模块和所述图像采集模块固定设置；
    所述调光模块设置为调节所述反射光线的传播方向；所述反射光线穿过所述目镜模块经所述调光模块反射后进入所述图像采集模块。
  4. 根据权利要求2所述的眼球追踪光学系统，其中，所述调光模块包括反射棱镜，
    所述反射光线经所述反射棱镜的反射面反射后进入所述图像采集模块。
  5. 根据权利要求4所述的眼球追踪光学系统，其中，所述反射棱镜的反射面包括增反膜；
    所述增反膜设置为提高所述反射光线的反射效率。
  6. 根据权利要求2所述的眼球追踪光学系统，其中，所述光源模块包括阵列红外波段光源，设置为出射阵列红外波段光线。
  7. 根据权利要求6所述的眼球追踪光学系统，其中，所述调光模块包括红外截止片，设置为反射所述阵列红外波段光源出射的红外波段光线到所述图像采集模块。
  8. 根据权利要求1所述的眼球追踪光学系统，其中，所述目镜模块包括第一固定透镜，所述第一光路调节模块包括第二固定透镜和可调透镜；
    所述第一固定透镜的光轴、所述第二固定透镜的光轴和所述可调透镜的光轴位于同一直线上；所述可调透镜可沿所述直线的方向移动。
  9. 根据权利要求1所述的眼球追踪光学系统，其中，还包括显示屏；
    所述显示屏位于所述第一光路调节模块远离所述用户眼球的一侧，所述显示屏为多维度显示屏，设置为显示多维度图像。
  10. 一种头戴式设备，包括头戴装置和权利要求1至9中任一项所述的眼球追踪光学系统。
PCT/CN2023/101522 2022-06-21 2023-06-20 一种眼球追踪光学系统及头戴式设备 WO2023246816A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210705618.2A CN117310976A (zh) 2022-06-21 2022-06-21 一种眼球追踪光学系统及头戴式设备
CN202210705618.2 2022-06-21

Publications (1)

Publication Number Publication Date
WO2023246816A1 true WO2023246816A1 (zh) 2023-12-28

Family

ID=89283583

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/101522 WO2023246816A1 (zh) 2022-06-21 2023-06-20 一种眼球追踪光学系统及头戴式设备

Country Status (2)

Country Link
CN (1) CN117310976A (zh)
WO (1) WO2023246816A1 (zh)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109581655A (zh) * 2019-01-08 2019-04-05 北京七鑫易维信息技术有限公司 一种抑制透镜反光的眼球追踪系统及眼球追踪方法
CN109725416A (zh) * 2019-03-13 2019-05-07 北京七鑫易维信息技术有限公司 眼球追踪光学系统、头戴式设备及成像方法
CN109946837A (zh) * 2018-08-31 2019-06-28 华为技术有限公司 一种光学成像系统
CN209117975U (zh) * 2018-12-03 2019-07-16 北京七鑫易维信息技术有限公司 一种眼球追踪模组和头戴式显示设备
US10832051B1 (en) * 2016-06-13 2020-11-10 Facebook Technologies, Llc Eye tracking using optical coherence methods
US20210041948A1 (en) * 2019-08-06 2021-02-11 Apple Inc. Eye Tracking System
CN114563871A (zh) * 2020-11-27 2022-05-31 华为技术有限公司 眼动追踪装置及电子设备

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10832051B1 (en) * 2016-06-13 2020-11-10 Facebook Technologies, Llc Eye tracking using optical coherence methods
CN109946837A (zh) * 2018-08-31 2019-06-28 华为技术有限公司 一种光学成像系统
CN209117975U (zh) * 2018-12-03 2019-07-16 北京七鑫易维信息技术有限公司 一种眼球追踪模组和头戴式显示设备
CN109581655A (zh) * 2019-01-08 2019-04-05 北京七鑫易维信息技术有限公司 一种抑制透镜反光的眼球追踪系统及眼球追踪方法
CN109725416A (zh) * 2019-03-13 2019-05-07 北京七鑫易维信息技术有限公司 眼球追踪光学系统、头戴式设备及成像方法
US20210041948A1 (en) * 2019-08-06 2021-02-11 Apple Inc. Eye Tracking System
CN114563871A (zh) * 2020-11-27 2022-05-31 华为技术有限公司 眼动追踪装置及电子设备

Also Published As

Publication number Publication date
CN117310976A (zh) 2023-12-29

Similar Documents

Publication Publication Date Title
US9999348B2 (en) Compact eye imaging and eye tracking apparatus
US11206978B2 (en) Meta-optics-based systems and methods for ocular applications
US9606354B2 (en) Heads-up display with integrated display and imaging system
US9001030B2 (en) Heads up display
JP2022176291A5 (zh)
TW201831953A (zh) 基於經由光導光學元件之視網膜成像的眼動追蹤器
CN209117975U (zh) 一种眼球追踪模组和头戴式显示设备
US20160135675A1 (en) System for detecting optical parameter of eye, and method for detecting optical parameter of eye
JP6688073B2 (ja) 光学システムおよび光学システムを有する装置
US10452911B2 (en) Gaze-tracking system using curved photo-sensitive chip
TWI716968B (zh) 頭戴式可視設備及用於頭戴式可視設備的眼球追蹤系統
WO2015035823A1 (en) Image collection with increased accuracy
CN114019678A (zh) 眼球追踪光学装置、光学系统、显示装置和显示系统
WO2023246812A1 (zh) 一种眼球追踪光学装置、系统和虚拟现实设备
WO2023246816A1 (zh) 一种眼球追踪光学系统及头戴式设备
WO2023246815A1 (zh) 一种眼球追踪光学系统及头戴式设备
WO2023246814A1 (zh) 一种眼球追踪光学系统及头戴式设备
CN114252998B (zh) 近眼显示装置
WO2023246813A1 (zh) 一种眼球追踪光学装置、系统和虚拟现实设备
CN221225161U (zh) 短距离光学放大模组、穿戴式显示设备和虚拟现实系统
US11743446B2 (en) Head-mounted viewable device and eye-tracking system for use in head-mounted viewable device
WO2024041488A1 (zh) 一种电子设备
CN219456642U (zh) 一种ar成像距离调节系统
US20230252671A1 (en) Gaze Tracking
TWM596350U (zh) 顯微鏡的光學構造

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23826463

Country of ref document: EP

Kind code of ref document: A1