CN118091945A - Near-eye display device and control method thereof - Google Patents
Near-eye display device and control method thereof Download PDFInfo
- Publication number
- CN118091945A CN118091945A CN202410234082.XA CN202410234082A CN118091945A CN 118091945 A CN118091945 A CN 118091945A CN 202410234082 A CN202410234082 A CN 202410234082A CN 118091945 A CN118091945 A CN 118091945A
- Authority
- CN
- China
- Prior art keywords
- display device
- color
- eye display
- changing unit
- haze
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000003287 optical effect Effects 0.000 claims abstract description 39
- 238000005286 illumination Methods 0.000 claims abstract description 32
- 239000000463 material Substances 0.000 claims description 40
- 230000004424 eye movement Effects 0.000 claims description 17
- 230000008859 change Effects 0.000 claims description 6
- 238000001556 precipitation Methods 0.000 claims description 6
- 239000002131 composite material Substances 0.000 claims description 4
- 239000004973 liquid crystal related substance Substances 0.000 claims description 3
- 230000001502 supplementing effect Effects 0.000 abstract description 21
- 239000013589 supplement Substances 0.000 description 19
- 238000010586 diagram Methods 0.000 description 11
- 230000000694 effects Effects 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 239000010408 film Substances 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 210000004087 cornea Anatomy 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 229910044991 metal oxide Inorganic materials 0.000 description 2
- 150000004706 metal oxides Chemical class 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- ZNOKGRXACCSDPY-UHFFFAOYSA-N tungsten trioxide Chemical compound O=[W](=O)=O ZNOKGRXACCSDPY-UHFFFAOYSA-N 0.000 description 2
- 239000013585 weight reducing agent Substances 0.000 description 2
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000004418 eye rotation Effects 0.000 description 1
- 239000005338 frosted glass Substances 0.000 description 1
- DCYOBGZUOMKFPA-UHFFFAOYSA-N iron(2+);iron(3+);octadecacyanide Chemical compound [Fe+2].[Fe+2].[Fe+2].[Fe+3].[Fe+3].[Fe+3].[Fe+3].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-].N#[C-] DCYOBGZUOMKFPA-UHFFFAOYSA-N 0.000 description 1
- 230000001795 light effect Effects 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 239000011344 liquid material Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000007747 plating Methods 0.000 description 1
- 229920000767 polyaniline Polymers 0.000 description 1
- 229920000128 polypyrrole Polymers 0.000 description 1
- 229920000123 polythiophene Polymers 0.000 description 1
- 229960003351 prussian blue Drugs 0.000 description 1
- 239000013225 prussian blue Substances 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000011343 solid material Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
- 230000037303 wrinkles Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/15—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on an electrochromic effect
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/15—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on an electrochromic effect
- G02F1/153—Constructional details
- G02F1/157—Structural association of cells with optical devices, e.g. reflectors or illuminating devices
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Nonlinear Science (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The application provides near-eye display equipment and a control method thereof, wherein the near-eye display equipment comprises lenses, a mirror frame, a light source, a first color changing unit, a control unit and an image acquisition unit; a light source disposed on the lens and/or the frame, the light source for providing illumination light to a display side of the lens; a first color changing unit disposed in an irradiation light exit direction of the light source to provide irradiation light transmitted from the first color changing unit to a display side of the lens; the control unit is used for adjusting the optical parameters of the first color changing unit; the image acquisition unit is arranged on the near-eye display device and is used for acquiring images of eyes of a user wearing the near-eye display device to obtain a target image. The near-eye display device can achieve good light supplementing effect on eyes of a user when different functions are achieved, and is convenient to achieve miniaturization and light weight of the near-eye display device.
Description
Technical Field
The application relates to the technical field of near-eye display, in particular to near-eye display equipment and a control method of the near-eye display equipment.
Background
At present, some near-eye display devices are provided with an eye tracking function and an iris recognition function, and in the process of realizing the two functions, the near-eye display devices have the problem of insufficient light near the eyes of users, so that some near-eye display devices supplement light to the eyes by arranging light sources so as to solve the problem of insufficient light, and the existing solutions are respectively provided with corresponding light sources or share one set of light sources, so that the weight and the volume of the near-eye display devices are increased by respectively arranging the corresponding light sources, and the weight and the volume of the near-eye display devices are not beneficial to the weight reduction and the miniaturization of the near-eye display devices; in the scheme of sharing one set of light source, the light supplementing modes and requirements required by the eye movement tracking function and the iris recognition function are not identical, so that the light supplementing effect is difficult to achieve by the two functions, and the problem of insufficient light is still caused.
Disclosure of Invention
The application provides a near-eye display device and a control method thereof, aiming at supplementing light to eyes of a user wearing the near-eye display device when the near-eye display device realizes an eye movement tracking function or an iris recognition function, and facilitating the realization of the weight reduction and the miniaturization of the near-eye display device.
In a first aspect, the present application provides a near-eye display device comprising:
Lenses and frames;
A light source provided on the lens and/or the frame, the light source being configured to provide illumination light to a display side of the lens;
A first color changing unit disposed in an irradiation light exit direction of the light source to provide irradiation light transmitted from the first color changing unit to a display side of the lens;
the control unit is used for adjusting the optical parameters of the first color changing unit;
The image acquisition unit is arranged on the near-eye display device and is used for acquiring images of eyes of a user wearing the near-eye display device to obtain a target image.
In an example, the control unit is configured to adjust the haze of the first color-changing unit when the near-eye display device turns on an eye tracking function, such that the adjusted haze is less than or equal to a preset haze threshold;
The control unit is further configured to adjust the haze of the first color-changing unit when the near-eye display device starts the iris recognition function, so that the adjusted haze is greater than the preset haze threshold.
In an example, the light source is disposed on the lens, and the first color changing unit is disposed on a display side of the lens;
The near-eye display device further comprises a second color changing unit, wherein the second color changing unit is arranged on the non-display side of the lens, and the non-display side is the side opposite to the display side; a projection of the first color shifting unit on the non-display side, located within the second color shifting unit;
The control unit is also used for adjusting the optical parameters of the second color changing unit.
In an example, the control unit is configured to adjust the haze of the second color-changing unit when the near-eye display device turns on an eye tracking function, such that the adjusted haze is less than or equal to a preset haze threshold;
The control unit is further configured to adjust the haze of the second color-changing unit when the near-eye display device starts the iris recognition function, so that the adjusted haze is greater than the preset haze threshold.
In an example, the first and second color changing units each include an electrochromic layer, and the control unit is configured to adjust a target voltage applied to the electrochromic layer to adjust the optical parameter of the electrochromic layer.
In one example, the electrochromic layer is made of at least one of the following materials: anode electrochromic material, cathode electrochromic material, dispersed liquid crystal based electrochromic material, film type electrochromic material, precipitation type electrochromic material, non-precipitation type electrochromic material, inorganic electrochromic material, organic electrochromic material and composite electrochromic material.
In an example, the first color-changing unit is integrally disposed with the light source, or the first color-changing unit is disposed at a distance from the light source.
In an example, the near-eye display device includes a plurality of the light sources, and at least one of the first color changing units is located in an outgoing direction of illumination light of at least two of the light sources.
In an example, the near-eye display device includes a plurality of light sources and a plurality of first color-changing units, the number of the light sources is the same as that of the first color-changing units, and the light sources are arranged in one-to-one correspondence with the first color-changing units.
In a second aspect, the present application also provides a control method of a near-eye display device, applied to the near-eye display device provided in the first aspect, the method comprising:
Determining function starting information of the near-eye display device;
Adjusting optical parameters of a first color changing unit according to the function starting information, so that a light source of the near-eye display device provides illumination light transmitted from the first color changing unit to a display side of a lens in the near-eye display device;
and acquiring an image of the eyes of a user wearing the near-eye display device to obtain a target image.
In an example, adjusting the optical parameter of the first color-changing unit according to the function-on information includes:
Adjusting the haze of the first color-changing unit so that the adjusted haze is less than or equal to a preset haze threshold value under the condition that the function starting information comprises an eye movement tracking function;
and under the condition that the function starting information comprises an iris recognition function, adjusting the haze of the first color-changing unit so that the adjusted haze is larger than a preset haze threshold.
In an example, adjusting the optical parameter of the first color-changing unit according to the function-starting information includes:
Determining a target voltage applied to the first color change unit according to the function starting information;
The target voltage is applied to the first color change unit.
The application provides near-eye display equipment and a control method thereof, wherein the near-eye display equipment comprises lenses, a mirror frame, a light source, a first color changing unit, a control unit and an image acquisition unit; a light source disposed on the lens and/or the frame, the light source for providing illumination light to a display side of the lens; a first color changing unit disposed in an irradiation light exit direction of the light source to provide irradiation light transmitted from the first color changing unit to a display side of the lens; the control unit is used for adjusting the optical parameters of the first color changing unit; the image acquisition unit is arranged on the near-eye display device and is used for acquiring images of eyes of a user wearing the near-eye display device to obtain a target image. When the near-eye display equipment needs to supplement light in different modes for the eyes of a user wearing the near-eye display equipment due to different functions, the illumination light provided by the light source can be transmitted through the first color-changing unit to supplement light for the eyes of the user through the adjustment of the optical parameters of the first color-changing unit, so that the corresponding light supplement requirements of different functions can be met, and compared with the case that different functions are respectively provided with different light sources, the size and the weight of the near-eye display equipment are reduced, so that the miniaturization and the light weight of the near-eye display equipment are realized, and the near-eye display equipment can achieve a better light supplement effect for the eyes of the user under the condition that different functions are started.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a near-eye display device according to an embodiment of the present application;
Fig. 2 is a schematic structural diagram of a near-eye display device according to another embodiment of the present application;
FIG. 3 is an exploded view of a partial structure of a near-to-eye display device according to an embodiment of the present application;
FIG. 4 is a view of a use scenario of a near-eye display device according to an embodiment of the present application;
FIG. 5a is a schematic diagram of a partial structure of a near-eye display device according to an embodiment of the application;
FIG. 5b is a usage scenario diagram of the embodiment provided in FIG. 5 a;
FIG. 6 is a schematic diagram of a partial structure of a near-eye display device according to an embodiment of the application;
FIG. 7 is a schematic diagram of a partial structure of a near-eye display device according to another embodiment of the present application;
fig. 8 is a flowchart of an eye tracking method of a near-eye display device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The flow diagrams depicted in the figures are merely illustrative and not necessarily all of the elements and operations/steps are included or performed in the order described. For example, some operations/steps may be further divided, combined, or partially combined, so that the order of actual execution may be changed according to actual situations.
Some embodiments of the present application are described in detail below with reference to the accompanying drawings. The following embodiments and features of the embodiments may be combined with each other without conflict.
Referring to fig. 1 and fig. 2, fig. 1 is a schematic structural diagram of a near-eye display device 100 according to an embodiment of the application, and fig. 2 is a schematic structural diagram of a near-eye display device 100 according to another embodiment of the application.
As shown in fig. 1, the near-eye display device 100 includes a lens 10, a frame 20, a light source 30, a first color changing unit 40, a control unit, and an image collecting unit 50. Wherein, the light source 30 is arranged on the lens 10 and/or the frame 20, the light source 30 is used for providing illumination light to the display side of the lens 10; the first color changing unit 40 is disposed in an irradiation light emitting direction of the light source 30 to provide the irradiation light transmitted from the first color changing unit 40 to the display side of the lens 10; the control unit is used for adjusting the optical parameters of the first color changing unit 40; the image acquisition unit 50 is disposed on the near-eye display device 100, and the image acquisition unit 50 is configured to acquire an image of an eye of a user wearing the near-eye display device 100, so as to obtain a target image.
After the user wears the near-eye display device 100, the near-eye display device 100 images on the display side of the lens, so that the user can view the corresponding screen, and further realize the image display function, and thus, the display side of the lens of the near-eye display device 100 is a side close to the eyes of the user, and the side opposite to the display side of the lens of the near-eye display device 100 is a non-display side of the lens of the near-eye display device 100, and it can be understood that the non-display side of the lens of the near-eye display device 100 is far away from the eyes of the user and is close to the external environment.
Illustratively, as shown in fig. 1, the light source 30 is disposed on the lens 10 to provide illumination light to the display side of the lens 10, and in this arrangement, the first color changing unit 40 is also disposed on the lens 10.
In another embodiment, as shown in fig. 2, the light source 30 is provided on the frame 20, and the first color changing unit 40 is provided on the frame 20 in such a manner that irradiation light is supplied to the display side of the lens 10.
In another embodiment, when the light source 30 is provided on both the lens 10 and the frame 20, the first color changing unit 40 is provided on both the lens 10 and the frame 20.
It will be appreciated that the light source 30 is disposed on the lens 10 and/or the frame 20 and is capable of providing illumination light to the display side of the lens 10, and the first color changing unit 40 is disposed in the emitting direction of the illumination light of the light source 30, so that the illumination light emitted from the light source 30 can be emitted through the first color changing unit 40, so as to provide different light to the display side of the lens 10 when the optical parameters of the first color changing unit 40 are changed, thereby implementing different ways of light supplement to the eyes of the user wearing the near-eye display device 100.
Referring to fig. 3, fig. 3 is an exploded view of a partial structure of a near-eye display device 100 according to an embodiment of the application.
Specifically, the number of the light sources 30 is one or more, which is not limited in the present application; as shown in fig. 3, in the case where a plurality of light sources 30 are provided in the lens frame 20, the first color changing unit 40 may be shaped similar to the lens frame 20, for example, in a ring shape, so that the irradiation light emitted from each light source 30 can be transmitted from the first color changing unit 40.
The control unit is used for adjusting the optical parameters of the first color changing unit 40, so as to adjust the illumination light provided to the display side of the lens 10, such as adjusting the illumination area and the light intensity of the illumination light, so as to meet different light supplementing requirements of the near-eye display device 100.
In a specific implementation process, taking an eye movement tracking function and an iris recognition function as examples, under the two functions, the light supplementing requirements on the eyes of a user are different, through the adjustment of the optical parameters of the first color changing unit 40, the irradiation light emitted from the light source 30 can reach the eyes of the user in different states after passing through the first color changing unit 40, so as to realize different light supplementing modes, thereby meeting the light supplementing requirements of the near-eye display device 100 after the eye movement tracking function is started or after the iris recognition function is started, enabling the near-eye display device 100 to realize better light supplementing effects under the condition of starting different functions, and being beneficial to the light weight and the miniaturization of the near-eye display device 100 without setting and using various light sources 30, and improving the use experience of the user.
The following describes the working state of the near-eye display device 100 corresponding to the first color changing unit 40 when the eye tracking function is turned on or the iris recognition function is turned on, taking the haze as an example of the optical parameter.
Haze (haze) is the percentage of the total transmitted light intensity that is greater than 2.5 degrees from the incident light, and greater haze of a film means that the film is less glossy and transparent, especially the image is less bright. Therefore, by adjusting the haze of the first color changing unit 40, adjustment of the illumination light transmitted through the first color changing unit 40 can be achieved, so that the illumination light forms bright spots or surface light sources near the eyes of the user located on the display side of the lens, and further the light supplementing requirements of the near-eye display device 100 under different conditions are satisfied.
Referring to fig. 4, fig. 4 is a view illustrating a usage scenario of a near-eye display device 100 according to an embodiment of the application.
In some embodiments, the control unit is configured to adjust the haze of the first color changing unit 40 such that the adjusted haze is less than or equal to the haze threshold when the near-eye display device 100 turns on the eye tracking function.
It will be appreciated that eye tracking is a process of measuring the eye movement of a user. The purpose of eye tracking is to determine where the user looks (e.g., gaze point or gaze point). More precisely, the pupil position is located by using an image processing technology, coordinates are obtained, and the eye gazing or gazing point is calculated based on a preset algorithm to determine the sight line position of the user, and in a specific usage scene, based on the eye movement tracking function, the user can control the near-eye display device 100 by controlling the position of eye rotation or the dropping point of the sight line.
Illustratively, after the near-eye display device 100 turns on the eye tracking function and determines that light supplement to the eyes of the user is required, the control unit adjusts the haze of the first color changing unit 40 such that the adjusted haze is less than or equal to the haze threshold. It can be appreciated that, when the haze of the first color-changing unit 40 is less than or equal to the haze threshold, the first color-changing unit 40 is in a relatively transparent state as shown in fig. 4, and the illumination light emitted from the light source 30 can form a bright spot with higher light intensity at the cornea of the eye of the user after passing through the first color-changing unit 40 in the relatively transparent state, so that the image collected by the image collecting unit 50 is beneficial to the judgment of eye tracking, and further meets the light supplementing requirement of the near-eye display device 100 under the eye tracking function.
In other embodiments, the control unit is configured to adjust the haze of the first color changing unit 40 such that the adjusted haze is greater than the haze threshold when the near-eye display device 100 turns on the iris recognition function.
It will be appreciated that iris recognition is a human biometric technique, and that iris is a textile-like ring of various colors within the pupil of an eye, and that the iris of a human being can be used to effect identification because each iris contains a unique structure based on features such as crowns, crystals, filaments, spots, structures, pits, rays, wrinkles and lines. In a specific use scenario, the near-eye display device 100 can recognize the user identity through the iris recognition function, so that the privacy of the user is better protected or different services are provided for different users according to the recognized user identity result, and the use experience of the user is improved.
After the near-eye display device 100 turns on the iris recognition function and determines that light supplement is required to the eyes of the user, the control unit adjusts the haze of the first color changing unit 40 such that the adjusted haze is greater than the haze threshold. It can be understood that, when the haze of the first color-changing unit 40 is greater than the haze threshold, the first color-changing unit 40 is in a relatively non-transparent state, similar to a frosted glass state, and has a strong scattering effect, in this state, when the irradiation light emitted from the light source 30 irradiates the eyes of the user through the scattering of the first color-changing unit 40, the irradiation light is changed into a soft area light source 30 by the original strong point light source 30, that is, the iris of the user is illuminated by the soft area light source 30, and a strong light overexposure point is not easy to occur, so that the image collected by the image collecting unit 50 is more beneficial to the extraction and feature recognition of the iris texture, and further the light supplementing requirement of the near-eye display device 100 under the iris recognition function is satisfied.
It can be appreciated that after the near-eye display device 100 turns off the iris recognition function, the haze of the first color-changing unit 40 is adjusted to be less than or equal to the haze threshold, so that the first color-changing unit 40 changes back to a relatively transparent state, so as to improve the definition of the picture displayed on the display side of the lens.
It should be noted that, in the above embodiment, the haze threshold is 5%, and in an actual application scenario, different haze thresholds may be set according to different functions of the near-eye display device 100, so as to meet the light supplementing requirements under different functions.
Referring to fig. 5a and 5b, fig. 5a is a schematic partial structure diagram of a near-eye display device 100 according to an embodiment of the application, and fig. 5b is a view of a usage scenario of the embodiment of fig. 5 a.
In some embodiments, the light source 30 is disposed on the lens 10 and the first color changing unit 40 is disposed on the display side of the lens 10; the near-eye display device 100 further includes a second color changing unit 60, the second color changing unit 60 being disposed on a non-display side of the lens 10, the non-display side being a side opposite to the display side; a projection of the first color shifting unit 40 on the non-display side is located within the second color shifting unit 60; the control unit is also used for adjusting the optical parameters of the second color changing unit 60.
As shown in fig. 5a, a first color changing unit 40 is provided on the display side of the lens 10, and a second color changing unit 60 is provided on the non-display side of the lens 10; as shown in fig. 5b, after the light emitted from the light source 30 is reflected by the first color-changing unit 40, the light can be reflected again by the second color-changing unit 60 to provide corresponding light to the display side of the lens 10, so as to realize light supplement to eyes of a user. Furthermore, the control unit can also adjust the optical parameters of the second color changing unit 60 to meet the light supplementing requirement of the near-eye display device 100 when different functions are turned on.
In some embodiments, the control unit is configured to adjust the haze of the second color changing unit 60 such that the adjusted haze is less than or equal to a preset haze threshold when the near-eye display device 100 turns on the eye tracking function.
Illustratively, after the near-eye display device 100 turns on the eye tracking function and determines that light supplement is required to the eyes of the user, the control unit adjusts the haze of the first color changing unit 40 and adjusts the haze of the second color changing unit 60; specifically, the haze of the adjusted second color-changing unit 60 is less than or equal to the preset haze threshold, that is, the second color-changing unit 60 is in a relatively transparent state, the light reflected from the first color-changing unit 40 is not reflected again, so that a bright spot with higher light intensity can be formed at the cornea of the user, and the influence on the final analysis result due to the fact that a plurality of bright spots are formed by the re-reflection of the second color-changing unit 60 is avoided.
In other embodiments, the control unit is further configured to adjust the haze of the second color changing unit 60 such that the adjusted haze is greater than a preset haze threshold when the near-eye display device 100 turns on the iris recognition function.
After the near-eye display device 100 turns on the iris recognition function and determines that the light supplement to the eyes of the user is required, the control unit adjusts the haze of the first color changing unit 40 and adjusts the haze of the second color changing unit 60; specifically, the haze of the adjusted second color-changing unit 60 is greater than the preset haze threshold. It can be understood that in this case, the second color-changing unit 60 is in a relatively non-transparent state and has a strong scattering effect, the first color-changing unit 40 is also in a relatively non-transparent state, the light emitted from the light source 30 propagates to the second color-changing unit 60 after being reflected by the first color-changing unit 40, the second color-changing unit 60 reflects the light reflected from the first color-changing unit 40 again, and the reflected light irradiates the eyes of the user after being scattered by the first color-changing unit 40, so as to achieve a more uniform and soft illumination light-compensating effect of the surface light source 30.
For example, the preset haze threshold corresponding to the second color-changing unit 60 may be 5%.
It should be noted that, the preset haze threshold value corresponding to the first color-changing unit 40 and the preset haze threshold value corresponding to the second color-changing unit 60 are the same or different, and specific values and whether the values are the same may be set according to actual use conditions, which is not limited in the present application.
In some embodiments, the first and second color changing units 40 and 60 each include an electrochromic layer, and the control unit is used to adjust a target voltage applied to the electrochromic layer to adjust an optical parameter of the electrochromic layer.
Illustratively, the electrochromic layer is a device having different optical properties before and after applying a voltage, so that the illumination light emitted from the light source 30 can provide different forms of illumination light, such as a spot or a surface light source 30, to the display side of the lens 10 after passing through the electrochromic layer by applying different voltages to the electrochromic layer.
In a specific implementation process, for example, a voltage of 0v is applied to the electrochromic layer, the haze of the electrochromic layer is smaller than a preset haze threshold, in this case, the light supplementing requirement of the eye tracking function of the near-eye display device 100 can be met, while in the case that a voltage of 2 v is applied to the electrochromic layer, the haze of the electrochromic layer is larger than the preset haze threshold, in this case, the light supplementing requirement of the iris recognition function of the near-eye display device 100 can be met, and different target voltages with different magnitudes are applied to the electrochromic layer, so as to meet different light supplementing requirements, thereby achieving a better light supplementing effect.
The voltage magnitude of the target voltage is in the range of-5V to 5V, for example.
Further, the electrochromic layer is made of at least one of the following materials: anode electrochromic material, cathode electrochromic material, dispersed liquid crystal based electrochromic material, film type electrochromic material, precipitation type electrochromic material, non-precipitation type electrochromic material, inorganic electrochromic material, organic electrochromic material and composite electrochromic material.
It will be appreciated that the cathodic electrochromic material may be, for example, tungsten trioxide (WO 3); the thin film electrochromic material may be a solid material; the precipitated electrochromic material can be a solid-liquid convertible material, and the non-precipitated electrochromic material can be a liquid material; electrochromic materials include, but are not limited to, metal oxide materials, composite metal oxides, prussian blue, phthalocyanines, and heteropolyacids; the organic electrochromic materials include, but are not limited to, viologen, polypyrrole, polyaniline, and polythiophene. The above-described various materials are merely examples, and the present application is not limited to the specific type of materials used.
Fig. 6 is a schematic diagram of a partial structure of a near-eye display device 100 according to an embodiment of the application.
In some embodiments, the first color shifting unit 40 is integrally provided with the light source 30.
For example, the first color-changing unit 40 is attached to the light source 30 to realize an integrated arrangement of the first color-changing unit 40 and the light source 30; or the first color changing unit 40 is integrally provided with the light source 30 by means of a coating film.
Fig. 7 is a schematic view of a partial structure of a near-eye display device 100 according to another embodiment of the application.
In other embodiments, the first color shifting unit 40 is spaced apart from the light source 30.
For example, the first color-changing unit 40 is connected with the light source 30 or a component where the light source 30 is located, such as the lens frame 20 or the lens 10, so that a gap exists between the first color-changing unit 40 and the light source 30, and the illumination light emitted from the light source 30 enters the first color-changing unit 40 after passing through a section of propagation path, so that the light spot formed on the display side of the lens 10 is more uniform.
It should be noted that, the second color changing unit 60 is disposed integrally with the lens 10 or is disposed at a distance from the lens 10, where the second color changing unit 60 is disposed integrally with the lens 10 and is disposed on the lens 10 in a film plating or adhering manner; and is connected to the lens 10 through the support member 70 to achieve a spaced arrangement, the effect of which can be referred to as the effect of the corresponding arrangement of the first color-changing unit 40, and the description thereof will not be repeated.
In some embodiments, the near-eye display device 100 includes a plurality of light sources 30, and at least one first color changing unit 40 is located in an outgoing direction of illumination light of at least two of the light sources 30.
Illustratively, a plurality of light sources 30 are disposed on the near-eye display device 100 to supplement light to the eyes of the user, and the near-eye display device 100 includes one or more first color changing units 40, at least one first color changing unit 40 being capable of covering at least two light sources 30, enabling the covering of a plurality (at least two) of light sources 30 by one first color changing unit 40. In a specific embodiment, the near-eye display device 100 includes one first color-changing unit 40 and a plurality of light sources 30, where one first color-changing unit 40 covers all the light sources 30, so that a whole first color-changing unit 40 is used to cover all the light sources 30, so as to achieve a larger area of uniform light effect.
In other embodiments, the near-eye display device includes a plurality of light sources and a plurality of first color-changing units, the number of the light sources is the same as that of the first color-changing units, and the light sources are arranged in one-to-one correspondence with the first color-changing units.
The near-eye display device 100 includes a plurality of first color-changing units 40 and a plurality of light sources 30, where the number of the first color-changing units 40 is the same as the number of the light sources 30, and each light source 30 has the first color-changing units 40 individually arranged in the emitting direction of the illumination light of the light source 30, that is, the light sources 30 and the first color-changing units 40 are in a one-to-one correspondence relationship, and the number of the light sources 30 and the first color-changing units 40 can be selected according to practical use or manufacturing requirements, which is not limited in the present application.
According to the near-to-eye display device 100 provided by the application, under the condition that the eye movement tracking function is started, the optical parameters of the first color changing unit 40 are adjusted through the control unit, so that the irradiation light provided by the light source 30 can supplement light to eyes of a user in the form of light spots after being transmitted from the first color changing unit 40, thereby meeting the light supplement requirement under the eye movement tracking function, or under the condition that the iris recognition function is started, the control unit adjusts the optical parameters of the first color changing unit 40, so that the irradiation light provided by the light source 30 can supplement light to eyes of the user in the form of a soft surface light source 30 after being transmitted from the first color changing unit 40, thereby meeting the light supplement requirement under the iris recognition function, avoiding a plurality of different sets of light sources 30, achieving better light supplement effects under different use scenes, being beneficial to realizing miniaturization and light quantification of the near-to the display device 100 and improving the use experience of the user.
Referring to fig. 8, fig. 8 is a flowchart illustrating an eye tracking method of a near-eye display device according to an embodiment of the application. The eye tracking method may be applied to a near-eye display device, which may include AR glasses, VR glasses, AR helmets, VR helmets, and the like, without limitation.
As shown in the figure, the control method of the near-eye display device includes S101 to S103.
S101, determining function starting information of the near-eye display device.
For example, function start information of the near-eye display device is determined in response to a function start instruction, wherein the function start information includes an eye movement tracking function or an iris recognition function.
S102, adjusting optical parameters of a first color changing unit according to the function starting information, so that a light source of the near-eye display device provides illumination light transmitted from the first color changing unit to a display side of a lens in the near-eye display device.
For example, the light source of the near-eye display device provides illumination light, the illumination light provided by the light source can illuminate the first color-changing unit, and the corresponding illumination light is provided for the display side of the lens of the near-eye display device after being transmitted by the first color-changing unit so as to supplement light for eyes of a user wearing the near-eye display device, so that the illumination light form of the display side of the lens is related to the state of the first color-changing unit, and the illumination light form of the display side of the lens can be changed by adjusting the first color-changing unit so as to meet different light supplement requirements.
S103, acquiring an image of the eyes of a user wearing the near-eye display device to obtain a target image.
For example, after the eye of the user wearing the near-eye display device is subjected to light filling, a target image obtained after the image acquisition unit performs image acquisition processing on the eye of the user is acquired, based on the target image, corresponding analysis can be performed according to the acquired target image, for example, eye movement analysis is performed according to the target image, so as to realize eye movement tracking, or iris recognition is performed according to the target image, so that identity recognition of the user is completed based on the iris. It can be understood that the eyes of the user are supplemented with light, so that the eyes of the user in the target image acquired by the image acquisition unit are clearer, and the accuracy and the efficiency of the analysis result are improved.
For example, the control unit of the near-eye display device is configured to adjust an optical parameter of the first color-changing unit according to the function-on information, and specifically, the control unit is configured to adjust the optical parameter of the first color-changing unit to be a first optical parameter or a second optical parameter; under the condition that the optical parameter of the first color changing unit is the first optical parameter, the image acquisition unit obtains a first target image, and the control unit is used for determining eye movement information of the user according to the first target image so as to realize eye movement tracking of the user. Under the condition that the optical parameters of the first color changing unit are second optical parameters, the image acquisition unit obtains a second target image, the control unit is further used for determining iris information of a user according to the second target image and completing identification of the user based on the iris information, so that under the condition that the near-to-eye display equipment is opened with different functions, the control unit can adjust the first color changing unit to enable the first color changing unit to be in different states, different light supplementing requirements on eyes of the user are met, and the target image acquired by the image acquisition unit is combined to complete corresponding functions.
In some embodiments, the adjusting the optical parameter of the first color-changing unit according to the function-starting information includes: adjusting the haze of the first color-changing unit so that the adjusted haze is less than or equal to a preset haze threshold value under the condition that the function starting information comprises an eye movement tracking function; and under the condition that the function starting information comprises an iris recognition function, adjusting the haze of the first color-changing unit so that the adjusted haze is larger than a preset haze threshold.
The optical parameters include haze, and after the near-eye display device starts the eye tracking function, the control unit adjusts the haze of the first color-changing unit so that the adjusted haze is smaller than or equal to a preset haze threshold value, thereby meeting the light supplementing requirement under the eye tracking function; and after the near-eye display device starts the iris recognition function, the control unit adjusts the haze of the first color-changing unit, so that the adjusted haze is larger than a preset haze threshold value to meet the light supplementing requirement under the iris recognition function. It should be noted that, the specific states and the effects of the light irradiation under the two functions of the first color changing unit can be referred to the foregoing embodiments, and will not be described herein.
In some embodiments, the adjusting the optical parameter of the first color-changing unit according to the function-starting information includes: determining a target voltage applied to the first color change unit according to the function starting information; the target voltage is applied to the first color change unit.
The control unit may adjust the optical parameters of the first color-changing unit by adjusting the target voltage applied to the first color-changing unit, and the specific implementation process may refer to the foregoing embodiments and will not be described herein.
It is to be understood that the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments. While the application has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the application. Therefore, the protection scope of the application is subject to the protection scope of the claims.
Claims (12)
1. A near-eye display device, comprising:
Lenses and frames;
A light source provided on the lens and/or the frame, the light source being configured to provide illumination light to a display side of the lens;
A first color changing unit disposed in an irradiation light exit direction of the light source to provide irradiation light transmitted from the first color changing unit to a display side of the lens;
the control unit is used for adjusting the optical parameters of the first color changing unit;
The image acquisition unit is arranged on the near-eye display device and is used for acquiring images of eyes of a user wearing the near-eye display device to obtain a target image.
2. The near-eye display device of claim 1, wherein the control unit is configured to adjust the haze of the first color-changing unit such that the adjusted haze is less than or equal to a preset haze threshold value, if the near-eye display device turns on an eye movement tracking function;
The control unit is further configured to adjust the haze of the first color-changing unit when the near-eye display device starts the iris recognition function, so that the adjusted haze is greater than the preset haze threshold.
3. The near-eye display device of claim 1, wherein the light source is disposed on the lens and the first color changing unit is disposed on a display side of the lens;
The near-eye display device further comprises a second color changing unit, wherein the second color changing unit is arranged on the non-display side of the lens, and the non-display side is the side opposite to the display side; a projection of the first color shifting unit on the non-display side, located within the second color shifting unit;
The control unit is also used for adjusting the optical parameters of the second color changing unit.
4. A near-eye display device as claimed in claim 3, wherein the control unit is configured to adjust the haze of the second color-changing unit such that the adjusted haze is less than or equal to a preset haze threshold value, in a case where the near-eye display device turns on an eye tracking function;
The control unit is further configured to adjust the haze of the second color-changing unit when the near-eye display device starts the iris recognition function, so that the adjusted haze is greater than the preset haze threshold.
5. A near-eye display device as claimed in any one of claims 1-4, wherein the first and second color-changing units each comprise an electrochromic layer, the control unit being adapted to adjust a target voltage applied to the electrochromic layer to adjust the optical parameter of the electrochromic layer.
6. The near-eye display device of claim 5, wherein the electrochromic layer is made of at least one of the following materials: anode electrochromic material, cathode electrochromic material, dispersed liquid crystal based electrochromic material, film type electrochromic material, precipitation type electrochromic material, non-precipitation type electrochromic material, inorganic electrochromic material, organic electrochromic material and composite electrochromic material.
7. A near-eye display device as claimed in any one of claims 1-4, wherein the first color-changing unit is provided integrally with the light source or the first color-changing unit is provided at a distance from the light source.
8. The near-eye display device of claim 7, comprising a plurality of the light sources, at least one of the first color changing units being located in an outgoing direction of illumination light of at least two of the light sources.
9. The near-eye display device of claim 7, wherein the near-eye display device comprises a plurality of the light sources and a plurality of the first color changing units, the number of the light sources is the same as the number of the first color changing units, and the light sources are arranged in one-to-one correspondence with the first color changing units.
10. A control method of a near-eye display device, characterized by being applied to the near-eye display device according to any one of claims 1 to 9, comprising:
Determining function starting information of the near-eye display device;
Adjusting optical parameters of a first color changing unit according to the function starting information, so that a light source of the near-eye display device provides illumination light transmitted from the first color changing unit to a display side of a lens in the near-eye display device;
and acquiring an image of the eyes of a user wearing the near-eye display device to obtain a target image.
11. The method for controlling a near-eye display device of claim 10, wherein adjusting the optical parameter of the first color-changing unit according to the function-on information comprises:
Adjusting the haze of the first color-changing unit so that the adjusted haze is less than or equal to a preset haze threshold value under the condition that the function starting information comprises an eye movement tracking function;
and under the condition that the function starting information comprises an iris recognition function, adjusting the haze of the first color-changing unit so that the adjusted haze is larger than a preset haze threshold.
12. The method for controlling a near-eye display device of claim 10, wherein adjusting the optical parameter of the first color-changing unit according to the function-on information comprises:
Determining a target voltage applied to the first color change unit according to the function starting information;
The target voltage is applied to the first color change unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410234082.XA CN118091945A (en) | 2024-02-29 | 2024-02-29 | Near-eye display device and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410234082.XA CN118091945A (en) | 2024-02-29 | 2024-02-29 | Near-eye display device and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118091945A true CN118091945A (en) | 2024-05-28 |
Family
ID=91163034
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410234082.XA Pending CN118091945A (en) | 2024-02-29 | 2024-02-29 | Near-eye display device and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118091945A (en) |
-
2024
- 2024-02-29 CN CN202410234082.XA patent/CN118091945A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11556007B2 (en) | Apparatus equipped with depth control function for enabling augmented reality | |
| US10522106B2 (en) | Methods and apparatus for active transparency modulation | |
| US10078236B2 (en) | Dimmer and video display device using the same | |
| CN107111145B (en) | Head-mounted display device and display method | |
| EP0611286B1 (en) | Method and apparatus for controlling perceived brightness using a time varying shutter | |
| US20170227791A1 (en) | Smart sunglasses, smart window and smart mirror apparatus for augmenting human vision by means of adaptive polarization filter grids | |
| CA2781064C (en) | Image magnification on a head mounted display | |
| US9389423B2 (en) | Head wearable display with adjustable transparency | |
| KR20170007485A (en) | Electronic spectacles | |
| US20140132484A1 (en) | Modifying virtual object display properties to increase power performance of augmented reality devices | |
| WO2008078320A2 (en) | Electronic transparency regulation element to enhance viewing through lens system | |
| CN105103033A (en) | Controlling brightness of displayed image | |
| KR20210043500A (en) | Hybrid see-through augmented reality systems and methods for low vision users | |
| EP2728397A2 (en) | Image display utilizing a variable mask to selectively block image data | |
| JP2018141826A (en) | Image display device | |
| JP5947464B1 (en) | Optical device | |
| US10209737B2 (en) | Virtual reality glasses | |
| CN118091945A (en) | Near-eye display device and control method thereof | |
| WO2016114130A1 (en) | Head-mounted display apparatus, and display method | |
| US20230237745A1 (en) | Lightweight optical device for augmented reality using state change optical element | |
| CN113467079B (en) | Intelligent glasses shielding lens, intelligent glasses and wearable system | |
| CN213276131U (en) | Display device with color-changing panel | |
| WO2022153683A1 (en) | Image display device and image display method | |
| EP4383061A1 (en) | Control module for adjusting a value of a parameter of a functionality of an optical element, optical device, computer implemented method and computer program | |
| US10527870B2 (en) | Eyewear for automatically detecting and blocking sources of glare |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |