CN111381367A - Eyeball tracker and display device - Google Patents
Eyeball tracker and display device Download PDFInfo
- Publication number
- CN111381367A CN111381367A CN201811608622.7A CN201811608622A CN111381367A CN 111381367 A CN111381367 A CN 111381367A CN 201811608622 A CN201811608622 A CN 201811608622A CN 111381367 A CN111381367 A CN 111381367A
- Authority
- CN
- China
- Prior art keywords
- lens
- spectroscope
- light source
- eyeball
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The invention provides an eyeball tracker which comprises a lens, a spectroscope, a structured light source and an image capturing element. The spectroscope is arranged on one side of the lens. The structured light source is arranged between the lens and the spectroscope. The image capturing element is arranged between the lens and the spectroscope, wherein the structured light source is used for emitting first light to the spectroscope, and the first light is reflected to the lens from the spectroscope and passes through the lens to be emitted to an eyeball. The first light beam is reflected from the eyeball to form a second light beam, wherein the second light beam passes through the lens and is emitted to the spectroscope, and is reflected from the spectroscope to the image capturing element. A display device is also provided.
Description
Technical Field
The present invention relates to an eyeball tracking technology, and more particularly, to an eyeball tracker and a display device using the same.
Background
The eyeball tracking technology is generally applied to a display device, so as to obtain the change of the eyeball or the periphery of the eyeball of a user while the user watches the display device, and determine the change of the eyeball or the periphery of the eyeball to interact with the display device. In other words, the eye tracking technology can be used to replace the existing operation interfaces such as keyboard, mouse, touch pad or touch panel.
In most conventional eye trackers, the light source is disposed around the lens and on a side of the lens facing the user's eyes. Therefore, the light pattern (light pattern) emitted from the light source is limited, and in addition, in order to make the light emitted from the light source emit to the eyeball in a concentrated manner, the light guide element needs to be arranged corresponding to the light source, which is difficult to meet the design requirement of lightness and thinness, and the accuracy of tracking the eyeball is affected by the assembling alignment error of the light source and the light guide element.
Disclosure of Invention
The invention provides an eyeball tracker and a display device using the eyeball tracker, which are beneficial to improving the accuracy of eyeball tracking.
The eyeball tracker of an embodiment of the present invention includes a lens, a beam splitter, a structured light source, and an image capturing element. The spectroscope is arranged on one side of the lens. The structured light source is arranged between the lens and the spectroscope. The image capturing element is arranged between the lens and the spectroscope, wherein the structured light source is used for emitting first light to the spectroscope, and the first light is reflected to the lens from the spectroscope and passes through the lens to be emitted to an eyeball. The first light beam is reflected from the eyeball to form a second light beam, wherein the second light beam passes through the lens and is emitted to the spectroscope, and is reflected from the spectroscope to the image capturing element.
The display device of an embodiment of the invention includes the eyeball tracker and a display panel. The display panel is arranged on one side of the spectroscope, and the spectroscope is positioned between the lens and the display panel.
Based on the above, the eyeball tracker and the display device using the eyeball tracker of the invention adopt the structural light source to track the eyeball or the change around the eyeball, so the eyeball tracking accuracy can be improved. In addition, because the structural light source is arranged between the lens and the spectroscope, light emitted by the structural light source is firstly emitted to the spectroscope and then reflected to the eyeball from the spectroscope, and other light guide elements are not required to be additionally arranged, so that the light and thin design requirement can be met.
In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanied with figures are described in detail below.
Drawings
Fig. 1 is a schematic diagram of a display device according to an embodiment of the invention.
Fig. 2 and fig. 3 are schematic diagrams of light patterns generated by a structured light source according to an embodiment of the invention.
Fig. 4 is a schematic diagram of a display device according to another embodiment of the invention.
[ notation ] to show
10: eyeball tracker
20: display panel
100. 100A: display device
101: lens and lens assembly
1011: first lens end
1012: second lens end
102: spectroscope
1021: first spectroscope end
1022: second beam splitter end
103: structured light source
1031: the first light ray
1032: the second light ray
104: image capturing element
105: processor with a memory having a plurality of memory cells
200: eyeball
D1: first distance
D2: second distance
D3: third distance
D4: a fourth distance
G1: first gap
G2: second gap
Detailed Description
Fig. 1 is a schematic diagram of a display device according to an embodiment of the invention. Referring to fig. 1, in the present embodiment, a display device 100 includes an eyeball tracker 10 and a display panel 20, wherein the eyeball tracker 10 is disposed on one side of the display panel 20, and the eyeball tracker 10 includes a lens 101, a beam splitter 102, a structured light source 103 and an image capturing element 104. The lens 101, the beam splitter 102 and the display panel 20 are arranged in sequence, that is, the beam splitter 102 is located between the lens 101 and the display panel 20. The light emitted from the display panel 20 can sequentially pass through the beam splitter 102 and the lens 101 to be emitted to the eyeball 200 of the user.
Specifically, the light source 103 is disposed between the lens 101 and the beam splitter 102, and the image capturing element 104 is disposed between the lens 101 and the beam splitter 102. The structured light source 103 may be a combination of a laser and a Diffractive Optical Element (DOE), or other combination of a non-visible light and a Diffractive optical element, which is not limited in the present invention. The structured light source 103 is configured to emit a first light ray 1031, and the first light ray 1031 has a specific light pattern due to the arrangement of the diffractive optical element, and the design end of the light pattern depends on the actual application requirement. On the other hand, the eyeball tracker 10 of the present embodiment and the display device 100 using the eyeball tracker 10 adopt the structured light source 103 to track the change of the eyeball 200 or the eyeball periphery, so the eyeball tracking accuracy can be improved.
Fig. 2 and fig. 3 are schematic diagrams of light patterns generated by a structured light source according to an embodiment of the invention. Referring to fig. 2 and 3, in an embodiment, the light pattern of the first light ray 1031 may be composed of a plurality of solid circles, and the solid circles may be concentric circles. In another embodiment, the light pattern of the first light ray 1031 may be composed of a plurality of dashed circles, and the dashed circles may be concentric circles. In other embodiments, the light pattern may be cross-shaped, or may be composed of a plurality of parallel solid or dashed stripes, but is not limited thereto.
Referring to fig. 1, the first light 1031 emitted by the structured light source 103 is first emitted to the beam splitter 102, then reflected from the beam splitter 102 to the lens 101 and passes through the lens 101 to be emitted to the eyeball 200. Then, the first light ray 1031 is reflected from the eyeball 200 to form a second light ray 1032, wherein the second light ray 1032 passes through the lens 101 and is emitted to the beam splitter 102, and is reflected from the beam splitter 102 to the image capturing device 104. Because the structured light source 103 is disposed between the lens 101 and the beam splitter 102, the light emitted from the structured light source 103 is first emitted to the beam splitter 102, and then reflected from the beam splitter 102 to the eyeball 200, and no additional light-guiding element is required, thereby meeting the design requirement of being light and thin.
In the present embodiment, the eyeball tracker 10 further includes a processor 105, and the structured light source 103 and the image capturing element 104 are electrically coupled to the processor 105. The Processor 105 may be a Central Processing Unit (CPU), a System On Chip (SOC) or other Programmable general purpose or special purpose microprocessor (microprocessor), a Digital Signal Processor (DSP), a Programmable controller, an Application Specific Integrated Circuit (ASIC), a Programmable Logic Device (PLD), other similar Processing devices or a combination thereof, and is configured to control the light emitted from the structure light source 103 and receive and process image signals.
Further, the image capturing element 104 converts the second light ray 1032 into an image signal after receiving the second light ray 1032, and transmits the image signal to the processor 105, and then the processor 105 performs an operation on the received image signal. The reflected light is changed along with the change of the eyeball 200 or the eyeball periphery, and the processor 105 compares the light pattern of the outgoing light (i.e., the first light 1031) with the light pattern of the reflected light (i.e., the second light 1032) to determine the change of the eyeball 200 or the eyeball periphery.
In the present embodiment, the lens 101 has a first lens end 1011 and a second lens end 1012 opposite to each other, and the beam splitter 102 has a first beam splitter end 1021 and a second beam splitter end 1022 opposite to each other. The first beam splitter end 1021 is disposed corresponding to the first lens end 1011, and the second beam splitter end 1022 is disposed corresponding to the second lens end 1012. On the other hand, the structured light source 103 and the image capturing element 104 are disposed at one side of the second lens end 1012, and the structured light source 103 is located between the second lens end 1012 and the image capturing element 104. That is, the structured light source 103 is closer to the second lens end 1012 than the image capturing element 104.
Specifically, a first gap G1 is provided between the first beam splitter end 1021 and the first lens end 1011, and a second gap G2 is provided between the second beam splitter end 1022 and the second lens end 1012. The second gap G2 is greater than the first gap G1, and as shown in fig. 1, the beam splitter 102 is inclined to the lens 101 and the display panel 20. On the other hand, the structured light source 103 and the image capturing element 104 are disposed in the second gap G2, wherein the structured light source 103 is separated from the second lens end 1012 by a first distance D1, and the structured light source 103 is separated from the second beam splitter end 1022 by a second distance D2. The image capturing element 104 is spaced apart from the second lens end 1012 by a third distance D3, and the image capturing element 104 is spaced apart from the second beam splitter end 1022 by a fourth distance D4. Wherein the second distance D2 is greater than the first distance D1, the fourth distance D4 is greater than the third distance D3, and the third distance D3 is greater than the first distance D1.
Fig. 4 is a schematic diagram of a display device according to another embodiment of the invention. Referring to fig. 4, the display device 100A of the present embodiment is substantially the same as the display device 100 of the previous embodiment, and only the differences will be described below. In the present embodiment, the image capturing element 104 is located between the second lens end 1012 and the structural light source 103, and further, a third distance D3 between the image capturing element 104 and the second lens end 1012 is smaller than a first distance D1 between the structural light source 103 and the second lens end 1012.
In summary, the eyeball tracker and the display device using the eyeball tracker of the present invention employ the structural light source to track the eyeball or the change around the eyeball, so that the accuracy of eyeball tracking can be improved. In addition, because the structural light source is arranged between the lens and the spectroscope, light emitted by the structural light source is firstly emitted to the spectroscope and then reflected to the eyeball from the spectroscope, and other light guide elements are not required to be additionally arranged, so that the light and thin design requirement can be met.
Although the present invention has been described with reference to the above embodiments, it should be understood that various changes and modifications can be made therein by those skilled in the art without departing from the spirit and scope of the invention.
Claims (10)
1. An eye tracker, comprising:
a lens;
the spectroscope is arranged on one side of the lens;
the structural light source is arranged between the lens and the spectroscope; and
the image capturing element is arranged between the lens and the spectroscope, wherein the structural light source is used for emitting first light to the spectroscope, the first light is reflected to the lens from the spectroscope and penetrates through the lens to be emitted to an eyeball, the first light is reflected from the eyeball to form second light, and the second light penetrates through the lens to be emitted to the spectroscope and is reflected to the image capturing element from the spectroscope.
2. The eye tracker according to claim 1, wherein the lens has a first lens end and a second lens end opposite to each other, and the beam splitter has a first beam splitter end and a second beam splitter end opposite to each other, the first beam splitter end being disposed corresponding to the first lens end, and the second beam splitter end being disposed corresponding to the second lens end.
3. The eye tracker according to claim 2, wherein said first beam splitter end and said first lens end have a first gap therebetween, and said second beam splitter end and said second lens end have a second gap therebetween, said second gap being larger than said first gap.
4. The eye tracker according to claim 3, wherein the structured light source and the image capturing element are disposed in the second gap.
5. The eye tracker according to claim 4, wherein the structured light source is located at a first distance from the second lens end and the structured light source is located at a second distance from the second beam splitter end, the second distance being greater than the first distance.
6. The eye tracker according to claim 5, wherein the image capturing element is spaced apart from the second lens end by a third distance, and the image capturing element is spaced apart from the second beam splitter end by a fourth distance, and wherein the fourth distance is greater than the third distance, and the third distance is greater than the first distance.
7. The eye tracker according to claim 5, wherein the image capturing element is spaced apart from the second lens end by a third distance, and the image capturing element is spaced apart from the second beam splitter end by a fourth distance, and wherein the fourth distance is greater than the third distance, and the third distance is smaller than the first distance.
8. The eye tracker according to claim 2, wherein the structural light source and the image capturing element are disposed at a side of the second lens end, and the structural light source is located between the second lens end and the image capturing element.
9. The eye tracker according to claim 2, wherein the structured light source and the image capturing element are disposed at a side of the second lens end, and the image capturing element is disposed between the second lens end and the structured light source.
10. A display device, comprising:
an eye tracker comprising:
a lens;
the spectroscope is arranged on one side of the lens;
the structural light source is arranged between the lens and the spectroscope; and
the image capturing element is arranged between the lens and the spectroscope, wherein the structural light source is used for emitting first light to the spectroscope, the first light is reflected to the lens from the spectroscope and penetrates through the lens to be emitted to an eyeball, the first light is reflected from the eyeball to form second light, and the second light penetrates through the lens to be emitted to the spectroscope and is reflected to the image capturing element from the spectroscope; and
and the display panel is arranged on one side of the spectroscope, and the spectroscope is positioned between the lens and the display panel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811608622.7A CN111381367A (en) | 2018-12-27 | 2018-12-27 | Eyeball tracker and display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811608622.7A CN111381367A (en) | 2018-12-27 | 2018-12-27 | Eyeball tracker and display device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111381367A true CN111381367A (en) | 2020-07-07 |
Family
ID=71219361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811608622.7A Pending CN111381367A (en) | 2018-12-27 | 2018-12-27 | Eyeball tracker and display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111381367A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5737012A (en) * | 1994-12-01 | 1998-04-07 | Olympus Optical Co., Ltd. | Head mounted image display apparatus and image forming apparatus related thereto |
| CN105531716A (en) * | 2013-07-30 | 2016-04-27 | 微软技术许可有限责任公司 | Near-eye optic positioning in display devices |
| CN106659541A (en) * | 2014-03-19 | 2017-05-10 | 直观外科手术操作公司 | Medical Devices, Systems, And Methods Integrating Eye Gaze Tracking For Stereo Viewer |
| CN107209390A (en) * | 2015-02-12 | 2017-09-26 | 谷歌公司 | The display of combination high-resolution narrow and intermediate-resolution wide field are shown |
| CN108205374A (en) * | 2018-01-02 | 2018-06-26 | 京东方科技集团股份有限公司 | Eyeball tracking module and its method, the video glass of a kind of video glass |
| CN108572447A (en) * | 2017-03-13 | 2018-09-25 | 宏达国际电子股份有限公司 | Head-mounted display apparatus, object follow-up mechanism and its object method for tracing |
| CN207924261U (en) * | 2018-03-29 | 2018-09-28 | 北京京东方光电科技有限公司 | Display device and virtual reality device |
-
2018
- 2018-12-27 CN CN201811608622.7A patent/CN111381367A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5737012A (en) * | 1994-12-01 | 1998-04-07 | Olympus Optical Co., Ltd. | Head mounted image display apparatus and image forming apparatus related thereto |
| CN105531716A (en) * | 2013-07-30 | 2016-04-27 | 微软技术许可有限责任公司 | Near-eye optic positioning in display devices |
| CN106659541A (en) * | 2014-03-19 | 2017-05-10 | 直观外科手术操作公司 | Medical Devices, Systems, And Methods Integrating Eye Gaze Tracking For Stereo Viewer |
| CN107209390A (en) * | 2015-02-12 | 2017-09-26 | 谷歌公司 | The display of combination high-resolution narrow and intermediate-resolution wide field are shown |
| CN108572447A (en) * | 2017-03-13 | 2018-09-25 | 宏达国际电子股份有限公司 | Head-mounted display apparatus, object follow-up mechanism and its object method for tracing |
| CN108205374A (en) * | 2018-01-02 | 2018-06-26 | 京东方科技集团股份有限公司 | Eyeball tracking module and its method, the video glass of a kind of video glass |
| CN207924261U (en) * | 2018-03-29 | 2018-09-28 | 北京京东方光电科技有限公司 | Display device and virtual reality device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8411289B2 (en) | Optical position detection device | |
| CN111580282B (en) | Light emitting module, depth camera, electronic equipment and control method | |
| US20020080120A1 (en) | Optical mouse | |
| US20020080117A1 (en) | Optical mouse | |
| US20160239093A1 (en) | Gesture sensing module | |
| KR20180124953A (en) | A staggered array of light emitting devices for sweeping angular ranges | |
| US20230244014A1 (en) | Optical element and optical module | |
| US9341796B2 (en) | Optical coupler and photoelectric conversion device having same | |
| JP2012173029A (en) | Optical position detection apparatus and display system with input function | |
| US20160069999A1 (en) | Depth image obtaining device and display device using same | |
| TWI410685B (en) | Light guide module, optical touch module, and method of increasing signal to noise ratio of optical touch module | |
| US9170684B2 (en) | Optical navigation device | |
| EP4187436A1 (en) | Display assembly and display device | |
| WO2017059643A1 (en) | Light guide lens, light source module and display device | |
| US8089466B2 (en) | System and method for performing optical navigation using a compact optical element | |
| CN111381367A (en) | Eyeball tracker and display device | |
| CN105572811A (en) | Surface-mounted type laser module group | |
| JP2013024579A (en) | Optical position detector and display system with input function | |
| US20130106786A1 (en) | Handwriting System and Sensing Method Thereof | |
| TWI547850B (en) | Optical detecting device capable of increasing signal-to-noise ratio and economizing power consumption | |
| US20200175269A1 (en) | Eye tracker and display | |
| JP2018524789A (en) | Optical lens, backlight module, and display device | |
| US20080117439A1 (en) | Optical structure, optical navigation system and method of estimating motion | |
| US11334742B2 (en) | Fingerprint identification method and apparatus, electronic device, and computer-readable storage medium | |
| CN111214239B (en) | Optical detection device applied to physiological feature identification |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200707 |