CN114660803A - Eye tracking system under screen - Google Patents
Eye tracking system under screen Download PDFInfo
- Publication number
- CN114660803A CN114660803A CN202210215192.2A CN202210215192A CN114660803A CN 114660803 A CN114660803 A CN 114660803A CN 202210215192 A CN202210215192 A CN 202210215192A CN 114660803 A CN114660803 A CN 114660803A
- Authority
- CN
- China
- Prior art keywords
- lens
- screen
- eye
- display screen
- tracking system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000004424 eye movement Effects 0.000 claims abstract description 11
- 230000010287 polarization Effects 0.000 claims abstract description 7
- 235000012771 pancakes Nutrition 0.000 abstract description 3
- 230000003287 optical effect Effects 0.000 description 6
- 238000009877 rendering Methods 0.000 description 4
- 230000033228 biological regulation Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 206010028813 Nausea Diseases 0.000 description 1
- 235000002911 Salvia sclarea Nutrition 0.000 description 1
- 244000182022 Salvia sclarea Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 208000003464 asthenopia Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 208000002173 dizziness Diseases 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008693 nausea Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a screen-under-eye movement tracking system which comprises an infrared camera, a display screen, a first lens, a second lens, an infrared LED and a human eye, wherein the display screen, the first lens and the second lens are arranged between the infrared camera and the human eye, the upper end and the lower end of the second lens are respectively provided with the infrared LED, the display screen is positioned on the right side of the first lens, the first lens is positioned on the right side of the second lens, the image side surface of the first lens is plated with a semi-transparent and semi-reflective film, the object side surface of the first lens is pasted with a quarter wave plate, and the image side surface of the second lens is pasted with a polarization reflective film. According to the invention, the light path design and space requirement of eye movement tracking are compressed to a very small space through the infrared camera under the screen, the image acquisition of eye movement is realized under the condition of limited space, the eye movement tracking system is applied to a pancake VR all-in-one machine, and the screen interference is avoided through the screen backlight time sequence, so that a clearer eye image is acquired.
Description
Technical Field
The invention relates to the technical field of VR (virtual reality), in particular to a screen under-eye tracking system.
Background
Eye tracking technology is used for VR all-in-one, can reduce the consumption of VR all-in-one through the point of fixation rendering, thereby improve equipment stand-by time, through eyes and neurobiology principle, discover that eyes only in the regional image of real world of point of fixation rendering with the high resolution, the remaining part is fuzzy outline, texture and colour, therefore with the help of eye tracking technology, VR equipment can only in the regional image of virtual world of point of fixation rendering with the high resolution according to this principle, when promoting the regional rendering effect of point of fixation by a wide margin, still reduced the consumption of equipment, the stand-by time of VR all-in-one has been promoted, eye tracking still provides brand-new interactive mode, support automatic interpupillary distance regulation, and functions such as identification, but current eye tracking technology has following shortcoming: 1. one of the major challenges plaguing modern VR/AR heads is the visual convergence regulation conflict, which easily causes the problems of eye fatigue, nausea, dizziness and the like of users; 2. the Fresnel VR optical scheme has a large space, the optical design space for eye movement tracking is large, visual presentation and glasses image acquisition are realized through the semi-reflective and semi-transparent optical lens, but with the application of the PANCAKE optical scheme, the space for light path design is extremely compressed, and the original eye movement tracking optical scheme cannot be realized.
Disclosure of Invention
The present invention is directed to an under-screen eye tracking system, which solves the above-mentioned problems of the prior art.
In order to achieve the purpose, the invention provides the following technical scheme: the utility model provides an eye moves tracker under screen, includes infrared camera, display screen, first lens, second lens, infrared LED and people's eye, be provided with display screen, first lens and second lens between infrared camera and the people's eye, and the upper and lower both ends of second lens all are provided with infrared LED.
Preferably, the display screen is positioned on the right side of the first lens, and the first lens is positioned on the right side of the second lens.
Preferably, the image side surface of the first lens is plated with a semi-transparent and semi-reflective film, the object side surface of the first lens is attached with a quarter-wave plate, and the image side surface of the second lens is attached with a polarization reflective film.
Preferably, the curvature radius of the image side surface of the second lens is 999.996mm, the thickness is 4.004mm, the aperture is 24mm, the refractive index is 1.54, the curvature radius of the object side surface of the second lens is-183.89 mm, the thickness is 4.373mm, the aperture is 24mm, the curvature radius of the image side surface of the first lens is wireless, the thickness is 8.504mm, the aperture is 24mm, the refractive index is 1.52, the curvature radius of the object side surface of the first lens is-70.934 mm, the thickness is 2.599mm, and the aperture is 24 mm.
Preferably, the first lens has an image side surface K of 1, A4 of 1.804E-06, A6 of-4.309E-09, the first lens has an object side surface K of-5.314, A4 of 0, A6 of 0, the second lens has an image side surface K of 1.001, A4 of 7.965E-07, and A6 of 3.656E-11.
Compared with the prior art, the invention has the following beneficial effects:
according to the invention, the light path design and space requirement of eye movement tracking are compressed to a very small space through the infrared camera under the screen, the image acquisition of eye movement is realized under the condition of limited space, the eye movement tracking system is applied to a pancake VR all-in-one machine, and the screen interference is avoided through the screen backlight time sequence, so that a clearer eye image is acquired.
Drawings
FIG. 1 is a schematic view of a display screen of the present invention in state 1;
FIG. 2 is a schematic view of the display screen of the present invention in state 2;
FIG. 3 is a schematic view of a second embodiment of the present invention;
FIG. 4 is a timing diagram of a screen and eye-moving camera at a 90Hz refresh rate according to the present invention;
FIG. 5 is a timing diagram of a screen and eye-moving camera at a 72Hz refresh rate according to the present invention.
In the figure: the device comprises an infrared camera 1, a display screen 2, a first lens 3, a second lens 4, an infrared LED 5 and human eyes 6.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The first embodiment is as follows:
a screen-under-eye movement tracking system comprises an infrared camera 1, a display screen 2, a first lens 3, a second lens 4, an infrared LED 5 and a human eye 6, wherein the display screen 2, the first lens 3 and the second lens 4 are arranged between the infrared camera 1 and the human eye 6, the upper end and the lower end of the second lens 4 are respectively provided with the infrared LED 5, the display screen 2 is positioned on the right side of the first lens 3, the first lens 3 is positioned on the right side of the second lens 4, the image side surface of the first lens 3 is plated with a semi-transparent and semi-reflective film, the object side surface of the first lens 3 is pasted with a quarter wave plate, the image side surface of the second lens 4 is pasted with a polarization reflective film, the curvature radius of the image side surface of the second lens 4 is 999.996mm, the thickness is 4.004mm, the aperture is 24mm, the refractive index is 1.54, the curvature radius of the object side surface of the second lens 4 is-183.89 mm, the thickness is 4.373mm, the aperture is 24mm, the curvature radius of the image side surface of the first lens 3 is wireless, 8.504mm in thickness, 24mm in aperture, 1.52 in refractive index, 70.934mm in radius of curvature of the object-side surface of the first lens 3, 2.599mm in thickness, 24mm in aperture, 1 in K of the image-side surface of the first lens 3, 1.804E-06 in a4, -4.309E-09 in a6, 5.314 in K of the object-side surface of the first lens 3, 0 in a4, 0 in a6, 1.001 in K of the image-side surface of the second lens 4, 7.965E-07 in a4, 3.656E-11 in a 6.
As shown in fig. 1, when the display screen 2 is in the state 1, the infrared LED 5 and the infrared camera 1 are activated. The infrared light emitted by the infrared LED 5 is reflected by human eyes 6, and is refracted by the second lens 4 and the first lens 3, and the light rays are emitted from the image side surface of the first lens 3 and are captured and imaged by the infrared camera 1.
As shown in fig. 2, when the display screen 2 is in the state 2, the circularly polarized light emitted from the display screen 2 is converted into linearly polarized light after passing through the first lens 3 and the quarter-wave plate, then returns to the first lens 3 after passing through the polarization reflective film, and then returns to the second lens 4 after passing through the semi-transparent semi-reflective film, and then enters the human eye 6 from the second lens 4 to form a virtual image.
Example two:
the optical system includes in proper order along light transmission direction: the display screen comprises a display screen, a partial reflector, a first lens, a second lens, a quarter-wave plate, a polarizing reflector and a third lens.
The object side surface of the third lens is in a plane surface type, the object side surface of the third lens is attached to the polarization reflector, the image side surface of the second lens is in a plane surface type, and the image side surface of the second lens is attached to the quarter-wave plate.
A. When the display screen is in the state 1, the infrared LED and the infrared camera are started, infrared light emitted by the infrared LED is reflected by human eyes, and is refracted by the third lens, the second lens and the first lens, light rays are emitted from the image side surface of the first lens and are captured by the infrared camera to form an image;
B. when the display screen is in the state 2, the circularly polarized light sent by the display screen is converted into linearly polarized light after passing through the first lens, the second lens and the quarter-wave plate, the circularly polarized light is converted into the quarter-wave plate after passing through the polarization reflecting film, the circularly polarized light is converted into the second lens through the second lens and the first lens, the second lens is folded back through the semi-transparent semi-reflecting film, and the human eyes are shot into the display screen from the third lens to form a virtual image.
In order to obtain a clear eye movement tracking image, the VR all-in-one machine adopts a fastlcd display screen, and adopts a scheme of a camera under the screen to obtain an eye movement image, when the screen backlight is turned off, the camera is exposed again to capture an eye image (as shown in figure 4), T1 is the time when the previous frame backlight is turned off, an infrared lamp is turned on at the T2 time delayed by 100us to illuminate eyes, the camera starts to be exposed under the screen at the same time, the lighting time of the infrared lamp and the shooting exposure time are both 1ms, and the infrared lamp is turned off and the exposure is finished at the T3 time.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (5)
1. The utility model provides an eye moves tracker under screen, includes infrared camera (1), display screen (2), first lens (3), second lens (4), infrared LED (5) and people's eye (6), its characterized in that: a display screen (2), a first lens (3) and a second lens (4) are arranged between the infrared camera (1) and the human eyes (6), and infrared LEDs (5) are arranged at the upper end and the lower end of the second lens (4).
2. An infra-screen eye tracking system according to claim 1, wherein: the display screen (2) is positioned on the right side of the first lens (3), and the first lens (3) is positioned on the right side of the second lens (4).
3. An infra-screen eye tracking system according to claim 1, wherein: the image side surface of the first lens (3) is plated with a semi-transparent and semi-reflective film, the object side surface of the first lens (3) is pasted with a quarter-wave plate, and the image side surface of the second lens (4) is pasted with a polarization reflective film.
4. An eye movement tracking system according to claim 1, wherein: the curvature radius of the image side surface of the second lens (4) is 999.996mm, the thickness is 4.004mm, the aperture is 24mm, the refractive index is 1.54, the curvature radius of the object side surface of the second lens (4) is-183.89 mm, the thickness is 4.373mm, the aperture is 24mm, the curvature radius of the image side surface of the first lens (3) is wireless, the thickness is 8.504mm, the aperture is 24mm, the refractive index is 1.52, the curvature radius of the object side surface of the first lens (3) is-70.934 mm, the thickness is 2.599mm, and the aperture is 24 mm.
5. An infra-screen eye tracking system according to claim 1, wherein: the K of the image side surface of the first lens (3) is 1, the A4 is 1.804E-06, the A6 is-4.309E-09, the K of the object side surface of the first lens (3) is-5.314, the A4 is 0, the A6 is 0, the K of the image side surface of the second lens (4) is 1.001, the A4 is 7.965E-07, and the A6 is 3.656E-11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210215192.2A CN114660803B (en) | 2022-03-07 | Under-screen eye movement tracking system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210215192.2A CN114660803B (en) | 2022-03-07 | Under-screen eye movement tracking system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114660803A true CN114660803A (en) | 2022-06-24 |
| CN114660803B CN114660803B (en) | 2024-05-31 |
Family
ID=
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115685616A (en) * | 2022-10-27 | 2023-02-03 | 深圳市华弘智谷科技有限公司 | Display device and eye movement tracking system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106842571A (en) * | 2017-01-18 | 2017-06-13 | 上海乐蜗信息科技有限公司 | The optical system of augmented reality equipment |
| CN111766702A (en) * | 2020-06-29 | 2020-10-13 | 京东方科技集团股份有限公司 | Near-to-eye display optical system for eyeball tracking |
| CN112352184A (en) * | 2018-06-18 | 2021-02-09 | 脸谱科技有限责任公司 | Optical assembly with curved reflective polarizer for head-mounted display |
| CN213934390U (en) * | 2020-09-27 | 2021-08-10 | 广州视享科技有限公司 | Image acquisition device, eyeball tracking system and head-mounted display |
| CN114077060A (en) * | 2020-08-10 | 2022-02-22 | 见臻科技股份有限公司 | Wearable eye tracking system |
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106842571A (en) * | 2017-01-18 | 2017-06-13 | 上海乐蜗信息科技有限公司 | The optical system of augmented reality equipment |
| CN112352184A (en) * | 2018-06-18 | 2021-02-09 | 脸谱科技有限责任公司 | Optical assembly with curved reflective polarizer for head-mounted display |
| CN111766702A (en) * | 2020-06-29 | 2020-10-13 | 京东方科技集团股份有限公司 | Near-to-eye display optical system for eyeball tracking |
| CN114077060A (en) * | 2020-08-10 | 2022-02-22 | 见臻科技股份有限公司 | Wearable eye tracking system |
| CN213934390U (en) * | 2020-09-27 | 2021-08-10 | 广州视享科技有限公司 | Image acquisition device, eyeball tracking system and head-mounted display |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115685616A (en) * | 2022-10-27 | 2023-02-03 | 深圳市华弘智谷科技有限公司 | Display device and eye movement tracking system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5621572A (en) | Optical system for a head mounted display using a retro-reflector and method of displaying an image | |
| US6147805A (en) | Head mounted display and viewing system using a remote retro-reflector and method of displaying and viewing an image | |
| JP2002544533A (en) | Reflective micro display system | |
| WO2021258078A1 (en) | Image display systems for eyebox expansion and methods of making the same | |
| CN111766702A (en) | Near-to-eye display optical system for eyeball tracking | |
| CN107065181B (en) | Optical system of virtual reality equipment | |
| CN110515208A (en) | Short-range optical system | |
| CN114415381A (en) | Optical imaging module and virtual reality equipment | |
| CN209400804U (en) | Augmented reality optics module and head-mounted display apparatus | |
| CN203465469U (en) | Wearable horizontal optical system | |
| CN107450188A (en) | A kind of nearly eye display device of 3D and method | |
| CN104460002A (en) | Wearable eye-level optical system | |
| WO2022199580A1 (en) | Electronic device and control method therefor | |
| CN213069318U (en) | Catadioptric display optical machine and near-to-eye display equipment | |
| CN114660803A (en) | Eye tracking system under screen | |
| CN114660803B (en) | Under-screen eye movement tracking system | |
| CN209803457U (en) | Head-mounted display optical system capable of reducing external stray light | |
| US20230418065A1 (en) | AR Smart Glasses | |
| CN113126299B (en) | Projection ray apparatus and head-mounted smart machine | |
| WO2022111601A1 (en) | Eye movement tracking apparatus and electronic device | |
| CN205880364U (en) | Eyepiece system with wear display device | |
| CN212586650U (en) | Augmented reality display system for improving image quality | |
| CN211123485U (en) | Intelligence MR glasses | |
| CN207408696U (en) | A kind of nearly eye display devices of 3D | |
| WO2023246814A1 (en) | Eyeball tracking optical system and head-mounted device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 201612 Room 501, building 3, No. 1, caosong Road, Xinqiao Town, Songjiang District, Shanghai Applicant after: Play Out Dreams (Shanghai) Technology Co.,Ltd. Address before: 201612 Room 501, building 3, No. 1, caosong Road, Xinqiao Town, Songjiang District, Shanghai Applicant before: Shanghai yuweia Technology Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant |