WO2023279923A1

WO2023279923A1 - Wearable display apparatus, light transmittance regulation method and apparatus, and device and medium

Info

Publication number: WO2023279923A1
Application number: PCT/CN2022/098714
Authority: WO
Inventors: 李晨; 韩武; 李由
Original assignee: 北京有竹居网络技术有限公司
Priority date: 2021-07-05
Filing date: 2022-06-14
Publication date: 2023-01-12
Also published as: CN115586643A

Abstract

The embodiments of the present disclosure relate to a wearable display apparatus, a light transmittance regulation method and apparatus, and a device and a medium. The wearable display apparatus comprises a wearing frame, imaging lenses, light-shielding lenses, an ambient light measurement unit, a gaze point detection unit and a control unit, wherein the imaging lenses are fixed in the wearing frame and are used for displaying a system image; the light-shielding lenses are arranged on the side of the imaging lenses that is away from eyes of an object; the ambient light measurement unit is used for measuring the brightness of ambient light; the gaze point detection unit is used for detecting a gaze point of the eyes of the object; and the control unit is connected to the ambient light measurement unit, the gaze point detection unit, the imaging lenses and the light-shielding lenses, and the control unit is used for regulating the brightness of the system image presented on the imaging lenses and regulating the transmittance of the light-shielding lenses on the basis of the gaze point and the brightness of ambient light. In this way, a presentation brightness and transmittance can be regulated on the basis of a viewing requirement of a wearer, such that the wearer clearly views both a virtual image and a real image, thereby improving the usage experience.

Description

Wearable display device, light transmittance adjustment method, device, equipment and medium

Cross References to Related Applications

This application is based on a Chinese patent application with the application number 202110755818.4, the filing date is July 05, 2021, and the title is "Wearable display device, light transmittance adjustment method, device, equipment and medium", and requires the Chinese patent application The priority of this Chinese patent application, the entire content of this Chinese patent application is hereby incorporated into this application as a reference.

technical field

The present disclosure relates to the technical field of augmented reality wearable display devices, and in particular to a wearable display device, a light transmittance adjustment method, a device, a device, and a medium.

Background technique

Augmented Reality (AR) wearable display devices, such as AR glasses are a new type of glasses. The system image displayed on the lens in the AR glasses is a virtual image, and the real image seen through the AR glasses is a real image. When wearing AR glasses, the experiencer will constantly change the gaze point of the eyes according to their own needs, so as to realize the free switching between virtual image viewing and real image viewing.

Usually, for AR glasses, when the experiencer's eyes see the real picture through the lens, the transmittance of the lens to light is fixed, which is mainly determined by the material of the lens and the coating technology. However, such glasses with fixed transmittance lenses often need to make a trade-off between viewing virtual images and real images, and cannot achieve clearer viewing of both virtual images and real images, resulting in poor user experience.

Contents of the invention

This Summary is provided to introduce a simplified form of concepts that are described in detail later in the Detailed Description. This summary of the invention is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to be used to limit the scope of the claimed technical solution.

In order to solve the above technical problems or at least partly solve the above technical problems, the present disclosure provides a wearable display device, a light transmittance adjustment method, device, equipment and medium, so as to realize the imaging brightness of the imaging lens of the wearable display device and The light transmittance of the shading lens is adapted to the adjustment of the point of gaze, so that the wearer can watch a clearer real image and a virtual image without having to choose between the two, which is conducive to improving the user experience.

An embodiment of the present disclosure provides a wearable display device, including a wearable frame, an imaging lens, a shading lens, an ambient light detection unit, a gaze point detection unit, and a control unit;

The imaging lens is fixed in the wearing frame, and the imaging lens is used to display the system picture;

The shading lens is arranged on the side of the imaging lens away from the subject's eyes;

The ambient light detection unit is used to detect ambient light brightness;

The gaze point detection unit is used to detect the gaze point of the subject's eyes;

The control unit is connected to the ambient light detection unit, the gaze point detection unit, the imaging lens, and the shading lens; the control unit is used to adjust the The brightness of the system picture displayed on the imaging lens and the transmittance of the light-shielding lens are adjusted.

An embodiment of the present disclosure also provides a light transmittance adjustment method for any of the above-mentioned devices, the method comprising:

Obtain the gaze point of the object's eyes;

Get ambient brightness;

Based on the point of gaze and the brightness of the ambient light, adjust the brightness of the system image displayed on the imaging lens and adjust the transmittance of the shading lens.

An embodiment of the present disclosure also provides a light transmittance adjustment device, including:

The point of fixation acquisition module is used to obtain the point of fixation of the object's eyes;

The ambient light brightness acquisition module is used to obtain the ambient light brightness;

An adjustment module, configured to adjust the brightness of the system image displayed on the imaging lens and adjust the transmittance of the shading lens based on the point of gaze and the brightness of the ambient light.

An embodiment of the present disclosure also provides an electronic device, which includes: a processor; a memory for storing instructions executable by the processor; and the processor, for reading the instruction from the memory. The instructions can be executed, and the instructions are executed to implement any one of the above-mentioned methods provided by the embodiments of the present disclosure.

An embodiment of the present disclosure also provides a computer-readable storage medium, the storage medium stores a computer program, and when the computer program is executed by a computer device, the computer device executes any one of the above-mentioned methods provided by the embodiments of the present disclosure. way.

Compared with the prior art, the technical solutions provided by the embodiments of the present disclosure have the following advantages:

The wearable display device provided by the embodiment of the present disclosure includes a wearing frame, an imaging lens, a shading lens, an ambient light detection unit, a fixation point detection unit, and a control unit; the imaging lens is fixed in the wearing frame, and the shading lens is arranged on the imaging lens away from the subject's eyes The ambient light detection unit is located on the side away from the subject’s eyes, and the fixation point detection unit is located on the side facing the subject’s eyes; wherein, the imaging lens is used to display the system picture, and the ambient light detection unit is used to detect the brightness of the ambient light. The point detection unit is used to detect the gaze point of the subject's eyes; the control unit is connected with the ambient light detection unit, the gaze point detection unit, the imaging lens and the light-shielding lens, and the control unit is used to adjust the system image in the imaging lens based on the gaze point and the brightness of the ambient light. The brightness presented on the screen and the transmittance of the light-shielding lens are adjusted. By adopting the above technical solution, it is possible to adjust the brightness of the system screen and the transmittance of the shading lens based on the gaze point and the brightness of the environment. The transmittance of the shading lens is related to the overall light transmittance of the wearable display device. Usually, the shading lens The higher the transmittance, the higher the transmittance of the wearable display device, thereby realizing the adjustment of the transmittance of the wearable display device; compared with the prior art, the technical solution of the embodiment of the present disclosure can realize the The adjustment of the light transmittance of the wearable display device improves the problem of poor user experience due to the inability to view both virtual and real images clearly due to the use of a shading lens with a fixed transmittance.

Description of drawings

The above and other features, advantages and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.

FIG. 1 is a schematic structural diagram of a wearable display device provided by an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of a three-dimensional structure of a wearable display device provided by an embodiment of the present disclosure under a viewing angle;

FIG. 3 is a schematic perspective view of a three-dimensional structure of a wearable display device provided by an embodiment of the present disclosure under another viewing angle;

FIG. 4 is a schematic structural diagram of a light-shielding lens in a wearable display device provided by an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of the principle of eye-tracking provided by an embodiment of the present disclosure;

FIG. 6 is a schematic flowchart of a method for adjusting light transmittance provided by an embodiment of the present disclosure;

FIG. 7 is a three-dimensional schematic diagram of a field of view partition provided by an embodiment of the present disclosure;

FIG. 8 is a two-dimensional schematic diagram of a field of view partition provided by an embodiment of the present disclosure;

FIG. 9 is a schematic structural diagram of a light transmittance adjustment device provided by an embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.

detailed description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein; A more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for exemplary purposes only, and are not intended to limit the protection scope of the present disclosure.

It should be understood that the various steps described in the method implementations of the present disclosure may be executed in different orders, and/or executed in parallel. Additionally, method embodiments may include additional steps and/or omit performing illustrated steps. The scope of the present disclosure is not limited in this regard.

As used herein, the term "comprise" and its variations are open-ended, ie "including but not limited to". The term "based on" is "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one further embodiment"; the term "some embodiments" means "at least some embodiments." Relevant definitions of other terms will be given in the description below.

It should be noted that concepts such as "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the sequence of functions performed by these devices, modules or units or interdependence.

It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative and not restrictive, and those skilled in the art should understand that unless the context clearly indicates otherwise, it should be understood as "one or more" multiple".

The names of messages or information exchanged between multiple devices and modules in the devices in the embodiments of the present disclosure are used for illustrative purposes only, and are not used to limit the scope of these messages or information.

The embodiment of the present disclosure provides a wearable display device, specifically AR glasses, which can be applied in various fields such as security and fire protection, industry, education, cultural tourism, logistics, aviation, retail, etc. In various scenarios combined with virtual screens (that is, "system screens"), by adjusting the brightness of the system screen on the imaging lens based on the point of gaze and the brightness of the environment and adjusting the transmittance of the shading lens, it is possible to watch the real image (i.e. "real picture") and virtual image (i.e. "system picture") are relatively clear, thereby improving the user experience of the wearer. The wearable display device and its transmittance adjustment method and device will be combined with specific embodiments below. , media, and equipment are illustrated.

In some embodiments, FIG. 1 is a schematic structural diagram of a wearable display device provided by an embodiment of the present disclosure, showing the information interaction relationship between various components; FIG. 2 and FIG. 3 are respectively provided by an embodiment of the present disclosure. The three-dimensional schematic diagram of the wearable display device under different viewing angles, showing the spatial relative positional relationship between the various components. 1-3, the wearable display device 10, taking glasses as an example, may include: a wearing frame 110, an imaging lens 120, a shading lens 130, an ambient light detection unit 140, a gaze point detection unit 150, and a control unit 160; The imaging lens 120 is fixed in the wearing frame 110, and the imaging lens 120 is used to display the system image; the shading lens 130 is arranged on the side of the imaging lens 120 away from the subject's eyes, and both the imaging lens 120 and the shading lens 130 are used to allow ambient light to pass through; The ambient light detection unit 140 is optionally arranged on the wearing frame, and is positioned on the side away from the subject's eyes, and the ambient light detection unit 140 is used to detect the brightness of the ambient light; the fixation point detection unit 150 is optionally arranged on the wearing frame 110, and is positioned at Towards the side of the subject's eyes, the fixation point detection unit 150 is used to detect the fixation point of the subject's eyes; the control unit 160 is connected with the ambient light detection unit 140, the fixation point detection unit 150, the imaging lens 120 and the shading lens 130; the control unit 160 uses Based on the point of gaze and the brightness of the ambient light, adjust the brightness of the system image displayed on the imaging lens 120 and adjust the transmittance of the shading lens 130 .

Wherein, the wearing frame 110 is used to directly or indirectly support and fix the imaging lens 120, the shading lens 130, the ambient light detection unit 140 and the fixation point detection unit 150, and the control unit 160 can be set to be fixedly supported by the wearing frame 110, or can be set on The remote server communicates with other components of the wearable display device 10 supported by the wearable frame 110 . Exemplarily, the fixed imaging lens 120, the shading lens 130, the ambient light detection unit 140 and the gaze point detection unit 150 can be detachably or non-detachably assembled with the wearing frame 110 to meet the requirements of flexible disassembly and maintenance or structural stability. .

Exemplarily, referring to FIG. 2 or FIG. 3 , the wearing frame 110 may include supporting legs, which may be placed on the ears on both sides of the subject's head, so as to realize the wearing of the wearable display device 10 . In other implementation manners, the wearing frame 110 can also be implemented in other structural forms known to those skilled in the art, which is not limited here.

Wherein, the imaging lens 120 is used to display a system picture, and the system picture is a virtual image; for example, the data used to form the system picture can be output by the control unit 160 . Further, in order to ensure a better viewing effect of real images, for example, to better restore the real brightness, the transmittance of the imaging lens 120 can be set to be greater than 80%, or greater than 95%, so as to avoid the influence of the imaging lens 120 on light.

Exemplarily, the system picture may be a picture projected onto the imaging lens 120 to be displayed, or may be a picture actively displayed by the imaging lens 120; for the former, the eye-mounted display device may further include a projection unit, and the projection unit may display the system picture projected and presented on the surface of the imaging lens 120 facing the subject's eyes. At this time, the projection unit can be powered by a power supply unit, and the imaging lens can be a lens with a fixed transmittance to reflect the system screen, that is, the projection unit The picture projected on the imaging lens is reflected into the eyes of the subject; for the latter, the imaging lens 120 can adopt a transparent display screen, and the transparent display screen can include display pixels arranged in an array, by controlling the color and brightness of each display pixel, realizing The presentation of the system picture, at this time, the imaging lens 120 is powered by a power supply unit; optionally, the imaging lens 120 can use a self-illuminating active device, such as a light-emitting diode display panel; it can also be a liquid crystal display that requires external light source illumination , such as a transmissive LCD or a reflective LCOS, which is not limited here.

Based on this, the adjustment of the brightness of the system picture presented on the imaging lens 120 can be realized by adjusting the picture projected by the projection unit, or by adjusting the display brightness of the light-emitting diode display panel or the liquid crystal display screen. The imaging principle selects the corresponding adjustment mode, which is not limited here.

Wherein, both the imaging lens 120 and the shading lens 130 can be used to allow ambient light to pass through, so that the wearable object can see the real picture through the wearable display device 10, and the real picture is a real image. Optionally, the wearable display device may be AR glasses or other augmented reality devices. The light-shielding lens 130 is disposed on the side of the imaging lens 120 away from the subject's eyes, which can avoid the influence of the light-shielding lens 130 on the system image, so that the subject can watch a clearer virtual image. Further, the transmittance of the light-shielding lens 130 is adjustable, for example, it can be varied between 0-100%, so as to adjust the proportion of ambient light that can pass through the light-shielding lens 130 . Wherein, when the transmittance is 0, ambient light cannot pass through the light-shielding lens 130; when the transmittance is 100%, ambient light can completely pass through the light-shielding lens 130; when the transmittance varies between 0-100%, , the greater the transmittance, the higher the proportion of ambient light that the light-shielding lens 130 allows to pass through.

Meanwhile, the transmittance of the light-shielding lens 130 is positively correlated with the transmittance of the wearable display device 10 , that is, the greater the transmittance of the light-shielding lens 130 , the higher the transmittance of the wearable display device 10 . Thus, by adjusting the transmittance of the light-shielding lens 130 , the transmittance of the wearable display device 10 can be adjusted.

Exemplarily, the light-shielding lens 130 may use electrochromic devices, liquid crystal devices, or other types of devices that can realize transmittance adjustment based on electrical signals (ie, current, voltage or power) known to those skilled in the art, which is not limited herein. . In the following, the structure of the light-shielding lens 130 will be described exemplarily by taking the light-shielding lens 130 using an electrochromic device as an example.

Wherein, the ambient light detection unit 140 is used to detect the brightness of the ambient light and transmit it to the control unit 160 . Wherein, the ambient light detection unit 140 is arranged on the side away from the subject's eyes. Referring to FIG. 2, taking the glasses structure shown in FIG. The picture is presented on the inner side of the wearing frame 110, thereby avoiding the influence of the brightness of the system picture itself on the detection of the ambient light brightness, making the detection accuracy of the ambient light brightness higher, which is conducive to realizing a more accurate measurement of the light transmittance of the glasses. Adjust to meet the needs of the object.

Exemplarily, the ambient light detection unit 140 can be a photosensitive unit, which can realize photoelectric conversion, that is, based on the intensity of the received light signal, convert it into an electrical signal of a corresponding magnitude; thus, by analyzing the magnitude of the electrical signal By performing the detection, the intensity of the corresponding optical signal can be determined, so as to realize the detection of the brightness of the ambient light.

Wherein, the gaze point detection unit 150 is used to detect the gaze point of the subject's eyes and transmit the gaze point to the control unit 160 . Wherein, the point of gaze detection unit 150 is arranged on the side of the wearing frame 110 facing the eyes of the subject. With reference to FIG. 3 , taking the glasses structure shown in FIG. , so that the spatial position of the gaze point can be more accurately located, which is conducive to realizing more accurate adjustment of the light transmittance of the glasses and meeting the use requirements of the object.

In other implementation manners, the ambient light detection unit 140 and the gaze point detection unit 150 may also be disposed at other positions of the wearable display device 10 , such as on the lens or other optional positions, which are not limited here.

Wherein, the control unit 160 is connected with the ambient light detection unit 140, the gaze point detection unit 150, the imaging lens 120 and the shading lens 130, and can adjust the brightness and shading of the imaged system picture on the imaging lens 120 based on the brightness of the ambient light and the gaze point. The transmittance of the lens 130 is to increase the transmittance when the subject looks at the real image to present a clearer real image, and when the subject looks at the virtual image, increase the brightness of the system screen and adaptively adjust the transmittance to present a clearer image. A clear virtual image; thereby meeting the needs of the object to see a clearer real image and virtual image. The specific adjustment method will be exemplified later in conjunction with the light transmittance adjustment method.

The wearable display device 10 provided by the embodiment of the present disclosure includes a wearable frame 110, an imaging lens 120, a shading lens 130, an ambient light detection unit 140, a gaze point detection unit 150, and a control unit 160, wherein the ambient light detection unit 140 can detect the environment Brightness, the gaze point detection unit 150 can detect the gaze point of the subject’s eyes, the transmittance of the light-shielding lens 130 is adjustable, and is positively correlated with the transmittance of the wearable display device 10, the imaging lens 120 can present the system image, and the control unit 160 The brightness of the system picture on the imaging lens 120 and the transmittance of the light-shielding lens 130 can be adjusted based on the point of gaze and the brightness of the ambient light, so that when the subject watches the system picture, high-definition images can be displayed on the imaging lens 120. Virtual image, when the object watches the real picture, the brightness and transmittance of the system screen can be adjusted so that the object can see a clearer real image. Therefore, using the wearable display device 10, it is possible to compare both the virtual image and the real image. Clear, thereby improving the object experience.

In some embodiments, the shading lens 130 includes an electrochromic device; the control unit 160 is used to adjust the transmittance of the shading lens 130 by controlling the voltage applied to the electrochromic device.

Wherein, the electrochromic device is a device that adjusts the voltage applied thereto based on the control unit 160 so as to realize the adjustment of transmittance. In this way, the method of adjusting the transmittance of the light-shielding lens 130 is simple and convenient, and is easy to realize.

Exemplarily, the light shielding lens 130 can be powered by a power supply unit, and the control unit 160 can adjust the voltage applied to the electrochromic device by controlling the supply voltage of the power supply unit. When the electrochromic device is working, the control unit 160 adjusts the voltage applied thereto. When the voltage increases, the transmittance decreases; or when the voltage increases, the transmittance increases. Therefore, the transmittance and the voltage can have a monotonous correlation, and the adjustment principle is simple.

In other embodiments, the transmittance and the voltage applied to the electrochromic device can also have other correlations, which can be set based on the requirements of the wearable display device and its light transmittance adjustment method, which is not limited here.

In other implementation manners, the light-shielding lens 130 can also be configured as a device that realizes light transmittance adjustment based on current, which will not be repeated or limited here.

In some embodiments, FIG. 4 is a schematic diagram of a film layer structure of a light-shielding lens in a wearable display device provided by an embodiment of the present disclosure, showing a film layer structure when the light-shielding lens 130 uses an electrochromic device. 4, the electrochromic device includes a first substrate 131, a first conductive layer 132, an electrochromic layer 133, an electrolyte layer 134, an ion storage layer 135, a second conductive layer 136 and a second substrate 137 . Optionally, the material of the first substrate 131 and the material of the second substrate 137 adopt a material whose transmittance is equal to or greater than a preset transmittance threshold; the first conductive layer 132 and the second conductive layer 136 include indium tin oxide electrodes layer; the material of the electrochromic layer 133 includes at least one of tungsten trioxide, polythiophene compounds and their derivatives, viologen compounds, tetrathiafulvalene compounds and metal phthalocyanine compounds; the electrolyte layer The material of 134 includes at least one of lithium perchlorate and sodium perchlorate; the material of ion storage layer 135 includes polythiophene: polystyrene sulfonic acid (PEDOT:PSS).

Wherein, the direction Z0 can be understood as the direction that the ambient light is perpendicular to the light-shielding lens 130 , and it can also be understood as the normal direction of the light-shielding lens 130 .

Wherein, the first substrate 131 and the second substrate 137 are used to support and protect various film layers located between them, and may be rigid substrates or flexible substrates, which are not limited herein.

Among them, by setting the first substrate 131 and the second substrate 132 to adopt materials whose transmittance is equal to or greater than the preset transmittance threshold, the transmittance of the first substrate 131 and the second substrate 132 can be made higher, so that the transmittance can be transparent. A more realistic picture of reality can be seen through the wearable display device.

Exemplarily, the preset transmittance threshold may be 80%, 88%, 95% or other transmittance thresholds, which may be set based on the design requirements of the wearable display device 10 and the usage requirements of the wearable object, and are not limited herein.

Wherein, the first conductive layer 132 and the second conductive layer 136 are used for receiving electrical signals, and the working current flows through the second conductive layer 136 , the ion storage layer 135 , the electrolyte layer 134 , the electrochromic layer 133 and the first conductive layer 132 .

Among them, the first conductive layer 132 and the second conductive layer 136 can be made of indium tin oxide (ITO) material, which is conducive to the formation of the first conductive layer 132 and the second conductive layer 136 with higher transmittance, so as to be able to transmit The wearable display device sees a more realistic picture of reality.

Exemplarily, the transmittance of the first conductive layer 132 and the second conductive layer 136 can be equal to or greater than 80%, 88%, 95% or other transmittance values, which can be based on the design requirements of the wearable display device 10 As well as the usage requirement setting of the wearing object, it is not limited here.

In other implementation manners, the first conductive layer 132 and the second conductive layer 136 can also be set as other conductive material layers with higher transmittance, which is not limited here.

Wherein, the electrolyte layer 134 is a pure ion conductor layer, which is used to isolate the electrochromic layer 133 and the ion storage layer 135; the ion storage layer 135 is used to store ions and electrons, and transfer ions or electrons to the electrochromic layer 133, In this way, the color change of the electrochromic device is realized, and the transmittance adjustment of the light-shielding lens 130 is further realized.

Wherein, the material of the electrochromic layer 133 includes tungsten trioxide (WO ₃ ), when a certain voltage is applied between the first conductive layer 132 and the second conductive layer 136, the material of the electrochromic layer 133 is oxidized under the action of the voltage. The reduction reaction can realize the adjustment of the transmittance of the electrochromic device by controlling the working current.

In other embodiments, the material of the electrochromic layer 133 can also include organic materials, such as polythiophene compounds and their derivatives, viologen compounds, tetrathiafulvalene compounds, and metal phthalocyanine compounds. At least one, or may include other inorganic materials or organic materials known to those skilled in the art, which is not limited herein.

Wherein, the electrolyte layer 134 may use at least one of lithium perchlorate and sodium perchlorate, and the ion storage layer 135 may use polythiophene:polystyrene sulfonic acid (PEDOT:PSS).

In other embodiments, the electrolyte layer 134 and the ion storage layer 135 may also use other materials known to those skilled in the art, which are not limited herein.

In other embodiments, the electrochromic device can also adopt other film layer structures known to those skilled in the art, which is not limited here.

In some embodiments, the film layer structure of the electrochromic device can also include a first substrate, a lower conductive layer, a reverse electrochromic layer, an ion conductor layer, an electrochromic layer, an upper conductive layer, and a second substrate that are stacked. Substrate; wherein, the electrochromic layer can use tungsten trioxide (WO ₃ ), the reverse electrochromic layer can use lithium-doped nickel oxide (NiOx:Li ⁺ ), and both the upper conductive layer and the lower conductive layer use indium tin oxide (ITO).

Based on this, the transmittance of the electrochromic device can be changed between 0-65%, the corresponding working current range is 20mA-10mA, and its global color change time is 1.5s.

In some embodiments, the gaze point detection unit 150 includes an infrared light source, an infrared camera, and a data processing subunit; the infrared light source is used to emit infrared light; the infrared camera is used to collect target images including the eyes of the subject; the data processing subunit uses Based on the position of the infrared light source and the target image, the gaze point of the subject's eyes is determined. Optionally, the infrared light source is powered by a power supply unit.

Among them, based on the position of the infrared light source and the infrared camera inside the wearable display device, the data processing unit is used to receive relevant position data and target image data, and calculate the corneal curvature center and pupil center to determine the gaze direction of the person; and further Specifically, based on the gaze direction, determine its intersection point as the gaze point of the subject's eyes.

The above-mentioned detection method of gaze direction and gaze point can be called pupil corneal reflection method, which has high detection accuracy and adopts a non-contact detection method, which does not constitute intrusion to the wearing object, and can improve the wearing comfort of the wearable display device.

Specifically: an infrared light source is irradiated on the cornea to produce a flickering point, which can be called Purkinje image, which is reflected by the light entering the pupil on the outer surface of the cornea (Corneal Reflection, CR). produce. Since the eyeball is similar to a sphere, the position of the flickering point irradiated on it basically does not change with the rotation of the eyeball.

In the eye tracking system of the wearable display device 10 (that is, the gaze point detection unit), under the condition that the positions of the infrared light source and the infrared camera remain unchanged, and on the basis of the structure of the eyeball model, the blinking point and the position of the infrared light source , the center of corneal curvature can be calculated. The pupil center can be obtained by processing the target image with image processing technology. The optical axis of the eyeball is obtained through the connection line between the center of corneal curvature and the center of the pupil, and the real line of sight direction, that is, the visual axis, is calculated by using the angle between the optical axis and the visual axis (that is, "θ" in Figure 5 below).

Exemplarily, FIG. 5 is a schematic diagram of a principle of gaze tracking provided by an embodiment of the present disclosure. Referring to Figure 5, in the eye-tracking system, the line connecting the center of the macula P2 and the center of the pupil O1 is called the visual axis, that is, the actual gaze direction of the human eye, and the actual estimate is the line connecting the center of the cornea O2 and the center of the pupil O1, which is called the visual axis. for the optical axis. Based on this, in the process of using the tracking system to locate the gaze direction, calibration is required to eliminate the inherent physiological deviation between the visual axis and the optical axis of the human eye, so as to obtain the real gaze direction or the position of the gaze point.

Exemplarily, when the subject's eyes include a left eye and a right eye, the intersection of the gaze direction of the left eye and the gaze direction of the right eye is the gaze point.

In other implementation manners, other methods known to those skilled in the art may also be used to determine the gaze direction and gaze point of the subject's eyes, which are not limited herein.

In the wearable display device 10 provided by the embodiment of the present disclosure, the fixation point detection unit 150 uses the pupil cornea reflection method to realize the fixation point detection of the subject’s eyes, with high detection accuracy and good comfort; the ambient light detection unit 140 detects ambient light Brightness, the control unit 160 adjusts the display brightness of the system picture presented on the imaging lens 120 based on the gaze point and the brightness of the environment, and adjusts the transmittance of the light-shielding lens 130, so that when the subject's eyes are watching the virtual image, a clearer system image can be adjusted. picture; and when the subject's eyes are fixed on the real image, a clearer realistic picture is adjusted. Therefore, by using the wearable display device 10 , both the virtual image and the real image can be viewed clearly, thereby improving the user experience of the object.

In the wearable display device shown above, each power supply unit can be set independently; or the power supply unit connected to each unit is the same power supply unit, and a conversion unit is set on the power supply line to provide power supply that meets the power supply requirements of each unit. Signal.

In some embodiments, the wearable display device may also include a manual adjustment unit (not shown in the figure); the manual adjustment unit is used to support manual adjustment of the brightness of the system image displayed on the imaging lens and/or the transmission of the shading lens Rate.

Wherein, the specific structural form of the manual adjustment unit may be a button, a knob, a button or other structural forms, which can be triggered based on clicking, rotating, touching, etc.

In other implementations, the brightness of the system screen and/or the transmittance of the shading lens can also be adjusted by the object intervention based on voice control, gesture control, and the like.

Wherein, the manual adjustment unit can be connected with the control unit 160, and the control unit 160 receives the manual adjustment signal output by the manual adjustment unit, and implements subsequent adjustment actions based on the manual adjustment signal.

Alternatively, the manual adjustment unit can also be directly connected to the imaging lens 120 , that is, directly adjusts the brightness of the system image presented by the imaging lens 120 without the control unit 160 .

Alternatively, the manual adjustment unit can also be directly connected to the light-shielding lens 130 , that is, directly adjust the transmittance of the light-shielding lens 130 without the control unit 160 . Exemplarily, in combination with the above, when the shading lens 130 uses an electrochromic device, the manual adjustment unit can directly adjust the voltage applied to the electrochromic device, thereby realizing the adjustment of the transmittance of the shading lens 130 .

In some embodiments, the field of view of the object (such as the field of view of the user wearing the wearable display device, that is, the spatial range of the user's sight) includes the field of view of the system picture, which corresponds to the display area on the imaging lens for displaying the system picture; optional Yes, the object field of view can also include the field of view of the display screen; from the comparison of the spatial phase position relationship, the field of view of the real picture surrounds the field of view of the system, see Figure 7 and Figure 8 below; the control unit includes a first adjustment subunit and a second adjustment subunit ; The first adjustment subunit is used to adjust the brightness of the system picture displayed on the imaging lens to the first brightness when the gaze point does not fall in the display area, for example, when it falls in the field of view of the real picture, and adjust the transmission of the shading lens rate, so that the brightness inside the device is a preset threshold, which corresponds to the preset object’s eye comfort brightness; the second adjustment subunit is used to adjust the brightness of the system image displayed on the imaging lens to the second when the gaze point falls in the display area Two brightness, and adjust the transmittance of the light-shielding lens, so that the ratio of the second brightness to the brightness inside the device is maintained at a preset comfortable contrast; wherein, the brightness inside the device is equal to the product of the ambient light brightness and the transmittance, and the first brightness is equal to or If it is less than the preset brightness threshold, the second brightness changes with the system screen.

Among them, when the gaze point does not fall in the display area, it indicates that the object is concerned with the real picture, not the system picture; for this, the first adjustment subunit lowers the brightness of the system picture, and the brightness value at this time is the first Brightness, and the first brightness is equal to or less than the preset brightness threshold, that is, the system screen is displayed in a power saving mode, thereby reducing the impact of the system screen on viewing the real screen; and reducing operating power and saving power consumption. At the same time, the first adjustment subunit adjusts the transmittance of the shading lens so that the product of the transmittance and the brightness of the ambient light meets the comfortable brightness requirements of the subject's eyes, that is, through the adjustment of the transmittance, the brightness inside the device is set to a preset threshold. In order to improve the comfort of the object watching the real image.

Exemplarily, the preset threshold is a preset comfortable brightness when the subject watches a real picture, for example, it may be 3000 lumens, or 2900 lumens-3100 lumens, or other brightness values or brightness ranges, which are not limited herein.

Among them, when the gaze point falls in the display area, it indicates that the object is concerned with the system picture, not the real picture; for this, the second adjustment subunit presents the system picture according to the content embodied in the picture itself, and its picture brightness, That is, the second brightness changes according to the content of the system screen, so as to display the content of the system screen more realistically. At the same time, the second adjustment subunit adjusts the transmittance of the shading lens so that the ratio of the brightness of the system screen to the brightness inside the device can meet the comfort contrast requirements of the overall field of view when the object watches the screen, that is, through the transmittance adjustment, the second brightness The ratio to the brightness inside the device is kept at a preset comfortable contrast, so as to improve viewing comfort within the entire range of the subject's field of vision when the subject watches the virtual image.

Exemplarily, the preset comfortable contrast ratio may be 80%, 86% or other brightness ratios, which may be set based on the viewing requirements of the object, which is not limited herein.

In some embodiments, the first adjustment subunit is further used to: adjust the transmittance of the light-shielding lens to the maximum transmittance when the gaze point does not fall in the display area and the ambient light brightness is lower than a preset threshold.

Specifically, when the object watches a real image and the ambient light brightness is high, based on the transmittance adjustment, the light brightness transmitted through the wearable display device can be reduced compared with the ambient light brightness, so as to meet the comfort requirements of the object when viewing the real image. . And when the preset threshold is constant, the higher the ambient light brightness is, the lower the transmittance of the shading lens is. However, when the brightness of the ambient light is low and cannot meet the comfortable brightness requirements for the object to watch the real image, it is necessary to use the first adjustment sub-unit to adjust the transmittance of the shading lens to the maximum transmittance, so that the ambient light can be as bright as possible. More through the wearable display device, thereby improving the problem of poor viewing comfort caused by low brightness.

Exemplarily, for different shading lenses, when the transmittance adjustment range is 0-100%, the maximum transmittance is 100%; when the transmittance adjustment range is 0-65%, the maximum transmittance It is 65%, and the maximum transmittance can be determined based on the transmittance adjustment range of the shading lens, and can be different values, which are not limited here.

In some embodiments, the improvement of the wearable display device compared with the prior art is also reflected in: on the basis of the existing AR glasses, a fixed display area is set as the system screen display area, which can also be called a virtual screen The display area corresponds to the field of view of the system screen, and the display area is a part of the visual field of view of the subject's eyes. Detect the gaze point of the wearing object's eyes through the gaze point detection unit, or detect its realization; when it is detected that the object's line of sight is concentrated on the display area, that is, the gaze point is located in the display area, then it is determined that the object is watching the virtual screen , thus triggering the adjustment of the brightness and light transmittance of the virtual screen, so that the virtual screen can be displayed clearly and comfortably. Keep detecting the object’s realization. Once it is detected that the object’s line of sight leaves the virtual screen display area, the display brightness of the virtual screen will be lowered to save power consumption; at the same time, the light transmittance of the shading lens will be adjusted until it is adjusted to a comfortable level for the object’s eyes. parameters, so as to achieve power saving and the effect that the picture seen by human eyes is comfortable at any time.

The above adjustment process can be realized automatically by the control unit, or manually by the manual adjustment unit.

Specifically, in the case of manual brightness and light transmittance adjustment, the adjustment may be performed based on the requirement of the subject to gaze at the visual field area, or based on the detected distribution of gaze points. Wherein, when the subject's eyes are fixed on the display area of the virtual picture, manually adjust the brightness of the virtual picture, optionally, simultaneously adjust the light brightness of the projected picture of the projection device and the light transmittance of the imaging lens; or simultaneously adjust the imaging brightness and The light transmittance of the imaging lens. Since the subjective experience of different wearers may be different, the default brightness initially set by the wearable display device may not be able to meet the viewing requirements of different wearers; for this, when the subject's eyes are fixed on the display area of the virtual screen, the wearer can manually adjust the virtual screen display brightness until a certain value, at this time, the wearable display device can store the brightness value, so as to maintain the brightness for display when the subject's eyes switch back to focus on the virtual screen display area next time. When the subject's eyes are watching the real picture, the brightness is manually adjusted. At this time, the light transmittance of the shading lens is actually adjusted. The wearer can manually adjust the light transmittance to a certain brightness that he thinks is comfortable, and the wearable display device can store the light transmittance at this time. Ambient light brightness and light transmittance values, that is, the brightness of the human eye side of the real picture set by the user. After the subsequent ambient light brightness changes or the line of sight is switched, the light transmittance of the shading lens is determined based on the brightness adjusted by the user and the ambient light brightness. , instead of using the default brightness to determine the light transmittance of the shaded lens.

Through the above manual adjustment process, the adjusted system screen display and real screen viewing parameters are stored so that they can be called during automatic adjustment, so that the wearable display device can meet the personalized viewing needs of different users and improve Use experience.

In the wearable display device 10 provided by the embodiment of the present disclosure, the control unit 160 adjusts the position of the gaze point presented on the imaging lens 120 based on the position of the gaze point in the field of view of the object, that is, the gaze point is in the field of view of the system screen or the field of view of the real screen, and the brightness of the ambient light. The display brightness of the system screen and the transmittance of the light-shielding lens 130 are adjusted, so that when the subject's eyes are watching the virtual image, a clearer system screen can be adjusted to meet the needs of viewing the virtual image; and when the subject's eyes are watching the real image, a clearer system screen can be adjusted. Realistic images to meet the needs of viewing real images. Therefore, by using the wearable display device 10 , both the virtual image and the real image can be viewed clearly, thereby improving the user experience of the object. On the basis of the above-mentioned embodiments, an embodiment of the present disclosure also provides a light transmittance adjustment method for any of the above-mentioned wearable display devices, which can realize the transmittance of the wearable display device by adjusting the transmittance of the light-shielding lens. For the adjustment of light transmittance, the higher the transmittance of the shading lens, the higher the light transmittance of the wearable display device. This method can be implemented by using any of the wearable display devices in the above embodiments, for example, in its control unit, and can also be applied to terminal equipment (such as mobile terminals such as smart phones) that communicate with any of the above wearable display devices. ) is realized, and has corresponding beneficial effects.

In some embodiments, FIG. 6 is a schematic flowchart of a method for adjusting light transmittance provided by an embodiment of the present disclosure. Referring to Fig. 6, the method includes the following steps.

S201. Obtain gaze points of the subject's eyes.

Wherein, the gaze point of the subject's eyes indicates the content that the subject pays attention to. For example, when the subject focuses on the virtual image, it indicates that the subject is paying attention to the system picture; when the subject focuses on the real image, it indicates that the subject is paying attention to the real picture.

Exemplarily, in combination with the above, the gaze point of the subject's eyes can be determined by the gaze point detection unit, and transmitted to the control unit; correspondingly, the control unit receives the gaze point of the subject's eyes.

S202. Acquire ambient light brightness.

Wherein, the brightness of ambient light affects the user's comfort when watching a picture, which will be described exemplarily in combination with comfortable contrast and comfortable brightness in the following text.

Exemplarily, in combination with the above, the ambient light detection unit may be used to determine the ambient light brightness and transmit it to the control unit; correspondingly, the control unit receives the ambient light brightness.

S203. Based on the point of gaze and the brightness of the ambient light, adjust the brightness of the system image displayed on the imaging lens and adjust the transmittance of the shading lens.

Among them, when the gaze point is concentrated on the real image, the object pays attention to the real picture. At this time, in order to watch a clearer real picture, the brightness of the system picture on the imaging lens can be lowered to avoid the influence of the system picture on the real picture; at the same time , by adjusting the transmittance of the light-shielding lens, the brightness inside the device can be adjusted to the comfortable brightness of the target's eyes, so as to improve the comfort of viewing real images.

Wherein, when the gaze point is concentrated on the virtual image, the subject pays attention to the system picture. At this time, in order to watch a clearer system picture, the brightness of the system picture displayed on the imaging lens can be kept at the normal brightness of the content displayed on the system picture; for example, if the For daytime scenes, the brightness of the screen is higher. If the night scene is displayed, the brightness of the screen can be lower, which is determined based on the content of the screen, so that the object can watch the system screen with high reducibility; at the same time, by adjusting the shading lens The transmittance can keep the ratio of the brightness of the system screen to the brightness inside the device at an appropriate ratio, so as to meet the comfort contrast ratio when the subject's eyes watch the overall screen, thereby improving the comfort when viewing virtual images.

Exemplarily, in this step, the control unit can determine the adjustment value or target value of the brightness of the system screen and the transmittance of the shading lens based on the point of gaze and the brightness of the ambient light, and further realize the adjustment, so as to meet the requirements of the wearing object. need.

The light transmittance adjustment method of the wearable display device provided by the embodiments of the present disclosure can adjust the brightness of the system screen and the transmittance of the light-shielding lens based on the obtained gaze point and ambient light brightness, so as to meet the requirements of the object viewing. Clear real and virtual images, thus improving the object experience.

In some embodiments, the adjustment step, that is, S203 needs to be implemented in conjunction with the relative position of the gaze point of the wearing object in its visual field zone, and will be described in conjunction with the visual field zone shown in FIG. 7 and FIG. 8 .

Exemplarily, FIG. 7 is a schematic perspective view of a field of view partition provided by an embodiment of the present disclosure, and FIG. 8 is a schematic plan view of a field of view partition provided by an embodiment of the present disclosure. Referring to FIG. 7 and FIG. 8 , the object view includes the system view and the real view surrounding the system view.

Wherein, the system picture is presented on the imaging lens, which corresponds to displaying in the display area of the imaging lens. The display area is located in the center of the subject's field of view, and the field of view occupied by the system picture (that is, the field of view of the system picture) is only a part of the subject's field of view. The field of view also includes the field of view of the real picture surrounding the field of view of the system picture, which may correspond to other areas on the imaging lens except the display area, and may also include areas other than the imaging lens. Therefore, the object view can be divided into two parts: the system view (ie, the virtual view) and the real view.

In some embodiments, by tracking the gaze direction of the subject's eyes, the belonging of the subject's observation area can be quickly distinguished, and by judging whether the gaze point of the subject's eyes is within the display area of the imaging lens, the visual field of the system screen and the real screen are realized. determination. Figure 7 and Figure 8 show the field of view distribution of the picture viewed by the subject's eyes after the binocular image is combined.

In other embodiments, in order to meet different user experiences or requirements, it is also set that the system screen view and the real screen view in the object view satisfy other spatial relative positional relationships, which are not limited here.

Based on this, S203 in FIG. 6 may specifically include:

When the gaze point does not fall in the display area, adjust the brightness of the system image displayed on the imaging lens to the first brightness, and adjust the transmittance of the light-shielding lens so that the brightness inside the device is a preset threshold;

When the gaze point falls in the display area, adjust the brightness of the system image displayed on the imaging lens to the second brightness, and adjust the transmittance of the light-shielding lens so that the ratio of the second brightness to the brightness inside the device remains at the preset comfortable contrast ;

The brightness inside the device is equal to the product of ambient light brightness and transmittance, the first brightness is equal to or less than a preset brightness threshold, and the second brightness varies with the system screen.

Among them, when the gaze point does not fall in the display area, it indicates that the object is concerned with the real picture, not the system picture; for this, the brightness of the system picture is lowered, and the brightness value at this time is the first brightness, and the first If the brightness is equal to or less than the preset brightness threshold, that is, the system screen is displayed in a power saving mode, thereby reducing the impact of the system screen on viewing real screens. At the same time, by adjusting the transmittance of the shading lens, the product of the transmittance and the brightness of the ambient light meets the comfortable brightness requirements of the subject's eyes, that is, through the transmittance adjustment, the brightness inside the device is set to a preset threshold to enhance the subject's viewing of real images comfort.

Among them, when the gaze point falls in the display area, it indicates that the object is paying attention to the system picture, not the real picture; for this, the system picture is presented according to the content embodied in the picture itself, and its picture brightness, that is, the second brightness varies with The contents of the system screens vary with each other, so as to more realistically display the contents of the system screens. At the same time, adjust the transmittance of the shading lens so that the ratio of the brightness of the system screen to the brightness inside the device can meet the comfort contrast requirements of the overall field of view when the object watches the screen, that is, through the adjustment of the transmittance, the ratio of the second brightness to the brightness inside the device can be adjusted. The ratio is kept at a preset comfortable contrast, so as to improve the viewing comfort within the overall scope of the subject's field of vision when the subject watches the virtual image.

In some embodiments, the preset threshold can be a fixed value set in advance, and can also be adjusted in real time based on usage requirements during the use of the wearable display device; similarly, the preset comfort contrast can also be a fixed value set in advance , or real-time adjustment based on usage requirements during the use of the wearable display device, which is not limited here.

In some embodiments, when the gaze point does not fall in the display area and the ambient light brightness is lower than a preset threshold, the transmittance of the light-shielding lens is adjusted to a maximum transmittance.

Specifically, when the object watches a real image and the ambient light brightness is high, based on the transmittance adjustment, the light brightness transmitted through the wearable display device can be reduced compared with the ambient light brightness, so as to meet the comfort requirements of the object when viewing the real image. . And when the preset threshold is constant, the higher the ambient light brightness is, the lower the transmittance of the shading lens is. However, when the brightness of the ambient light is low and cannot meet the comfortable brightness requirements for the object to watch the real image, it is necessary to adjust the transmittance of the shading lens to the maximum transmittance, so that as much ambient light as possible can pass through the wearable A display device, thereby improving the problem of poor viewing comfort caused by low brightness.

In some embodiments, with reference to the above, the wearable display device further includes a manual adjustment unit, which can support a manual re-adjustment function.

Specifically, after the self-adaptive adjustment process of the above-mentioned wearable display device is completed, it can also be adjusted manually, so as to flexibly meet the use requirements of different users or different scenarios.

In some embodiments, the method also includes:

Obtain the real-time brightness of the system screen presented on the imaging lens;

Determine whether the real-time brightness is equal to or less than the minimum brightness threshold;

When the real-time brightness is equal to or lower than the minimum brightness threshold, the real-time brightness is manually adjusted based on the ambient light brightness and the real-time brightness.

Wherein, the real-time brightness of the system image displayed on the imaging lens can be detected by a photosensitive unit and transmitted to the control unit; correspondingly, the control unit receives the real-time zero degree. Alternatively, the real-time brightness of the system image displayed on the imaging lens is adjusted and controlled by the control unit, and the control unit can directly call relevant data to obtain the real-time brightness.

Among them, the minimum brightness threshold is used to determine whether the real-time brightness is too small; specifically, when the real-time brightness is equal to or less than the minimum brightness threshold, it indicates that the real-time brightness is too small, that is, the overall brightness of the system picture presented on the imaging lens at this time is relatively dark , affecting the perception of the object. In view of this, the real-time brightness can be increased, that is, when the system picture presented on the imaging lens is dark, the real-time brightness of the system picture can be increased based on the ambient light brightness and real-time brightness until it meets the viewing needs of the object.

Specifically, when the brightness of the system screen is relatively dark, the wearing object can manually increase its brightness. For example, continuous adjustment can be performed based on real-time experience; or preset highlight mode, the process can be manually switched to highlight mode, in order to increase the brightness to meet the screen display requirements when the brightness of the smooth surface of the system is relatively dark .

In some embodiments, on the basis of FIG. 6, S201 may specifically include:

Obtain the gaze direction of different eyes of the object;

Based on the gaze direction of different eyes, fixation point is determined.

Specifically, the gaze directions of different eyes of the object may be determined first, and the intersection of the gaze directions may be determined as the gaze point.

In other implementation manners, other methods known to those skilled in the art may also be used to determine the gaze point, which is not limited herein.

An embodiment of the present disclosure also provides a light transmittance adjustment device of a wearable display device, which can be used to perform the steps of any one of the above methods to achieve corresponding beneficial effects.

Exemplarily, the light transmittance adjustment device of the wearable display device can be set in the control unit of the wearable display device, and implemented by using a software program; limited.

In some embodiments, FIG. 9 is a schematic structural diagram of a light transmittance adjustment device provided by an embodiment of the present disclosure. Referring to Figure 9, the device 30 may include:

Gaze point acquisition module 310, configured to acquire the gaze point of the object's eyes;

Ambient light brightness acquisition module 320, configured to obtain ambient light brightness;

The adjustment module 330 is configured to adjust the brightness of the system image displayed on the imaging lens and adjust the transmittance of the shading lens based on the point of gaze and the brightness of the ambient light.

The light transmittance adjustment device 30 of the wearable display device provided by the embodiment of the present disclosure can adjust the brightness of the imaged system image on the imaging lens and the brightness of the shading lens based on the brightness of the ambient light and the gaze point through the synergistic effect of the above-mentioned functional modules. Transmittance, to increase the transmittance when the subject looks at the real image to present a clearer real image, and when the subject looks at the virtual image, increase the brightness of the system screen and adaptively adjust the transmittance to present a clearer virtual image ; so as to achieve clearer viewing of virtual images and real images, thereby improving the experience of using the object.

In some embodiments, the adjustment module 330 is specifically used for:

In some embodiments, the adjustment module 330 is also specifically used for:

When the gaze point does not fall in the display area and the ambient light brightness is lower than a preset threshold, the transmittance of the shading lens is adjusted to a maximum transmittance.

In some embodiments, the wearable display device also supports manual readjustment functionality.

In some embodiments, when the system image presented on the imaging lens is relatively dark, the wearable display device supports manually increasing the brightness.

In some embodiments, the fixation point acquisition module 310 is specifically used for:

Obtain the gaze direction of different eyes of the object;

Based on the gaze direction of different eyes, fixation point is determined.

It should be noted that the light transmittance adjusting device 30 of the wearable display device shown in FIG. 9 can execute each step in the method embodiment shown in FIG. 6 and realize each process in the method embodiment shown in FIG. 6 and effects are not described here.

An embodiment of the present disclosure also provides an electronic device, and the electronic device includes: a processor; a memory for storing executable instructions of the processor; a processor, for reading executable instructions from the memory, and executing the instructions to implement the following: The steps of any one of the above methods provided in the embodiments of the present disclosure.

Embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored in the storage medium, and the computer program is used to execute the steps of any one of the above methods provided by the embodiments of the present disclosure.

An embodiment of the present disclosure also provides a computer program product, including a computer program/instruction, and when the computer program/instruction is executed by a processor, the steps of any one of the above methods are implemented.

FIG. 10 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Referring to FIG. 10 , it shows a schematic structural diagram of an electronic device 500 suitable for implementing an embodiment of the present disclosure.

The electronic device 500 in the embodiment of the present disclosure may include, but is not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), vehicle-mounted terminals ( Mobile terminals such as car navigation terminals) and stationary terminals such as digital TVs, desktop computers and the like. The electronic device shown in FIG. 10 is only an example, and should not limit the functions and application scope of the embodiments of the present disclosure.

As shown in FIG. 10, an electronic device 500 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 501, which may be randomly accessed according to a program stored in a read-only memory (ROM) 502 or loaded from a storage device 508. Various appropriate actions and processes are executed by programs in the memory (RAM) 503 . In the RAM 503, various programs and data necessary for the operation of the electronic device 500 are also stored. The processing device 501, ROM 502, and RAM 503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to the bus 504 .

Typically, the following devices can be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speaker, vibration an output device 507 such as a computer; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication means 509 may allow the electronic device 500 to perform wireless or wired communication with other devices to exchange data. While FIG. 10 shows electronic device 500 having various means, it is to be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, where the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via communication means 509, or from storage means 508, or from ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the light transmittance adjustment method of the wearable display device according to the embodiment of the present disclosure are executed.

It should be noted that the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and the server can communicate using any currently known or future network protocols such as HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), and can communicate with digital data in any form or medium The communication (eg, communication network) interconnections. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being incorporated into the electronic device.

The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device:

Obtain the gaze point of the object's eyes;

Get ambient brightness;

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, or combinations thereof, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages - such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (such as through an Internet Service Provider). Internet connection).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure may be implemented by software or by hardware. Wherein, the name of a unit does not constitute a limitation of the unit itself under certain circumstances.

The functions described herein above may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), System on Chips (SOCs), Complex Programmable Logical device (CPLD) and so on.

In the context of the present disclosure, a machine-readable medium (i.e., a computer-readable storage medium) may be a tangible medium that may contain or be stored for use by or in conjunction with an instruction execution system, apparatus, or device program to use. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

The above description is only a preferred embodiment of the present disclosure and an illustration of the applied technical principles. Those skilled in the art should understand that the disclosure scope involved in this disclosure is not limited to the technical solution formed by the specific combination of the above-mentioned technical features, but also covers the technical solutions formed by the above-mentioned technical features or Other technical solutions formed by any combination of equivalent features. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

In addition, while operations are depicted in a particular order, this should not be understood as requiring that the operations be performed in the particular order shown or performed in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while the above discussion contains several specific implementation details, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

A wearable display device, characterized in that it includes a wearable frame, an imaging lens, a shading lens, an ambient light detection unit, a gaze point detection unit, and a control unit;

The imaging lens is fixed in the wearing frame, and the imaging lens is used to display the system picture;

The shading lens is arranged on the side of the imaging lens away from the subject's eyes;

The ambient light detection unit is used to detect ambient light brightness;

The gaze point detection unit is used to detect the gaze point of the subject's eyes;

The control unit is connected to the ambient light detection unit, the gaze point detection unit, the imaging lens, and the shading lens; the control unit is used to adjust the The brightness of the system picture displayed on the imaging lens and the transmittance of the light-shielding lens are adjusted.
The device according to claim 1, wherein the shading lens comprises an electrochromic device;

The control unit is used for adjusting the transmittance of the light-shielding lens by controlling the voltage applied to the electrochromic device.
The device according to claim 2, wherein the electrochromic device comprises a first substrate, a first conductive layer, an electrochromic layer, an electrolyte layer, an ion storage layer, second conductive layer and second substrate.
The device according to claim 1, wherein the gaze point detection unit includes an infrared light source, an infrared camera and a data processing subunit;

The infrared light source is used to emit infrared light;

The infrared camera is used to collect target images including the eyes of the subject;

The data processing subunit is used to determine the gaze point of the subject's eyes based on the position of the infrared light source and the target image.
The device according to claim 1, wherein the imaging lens has a display area for displaying the system picture; the control unit includes a first adjustment subunit and a second adjustment subunit; the shading Both the lens and the imaging lens allow ambient light to pass through;

The first adjustment subunit is used to adjust the brightness of the system picture displayed on the imaging lens to the first brightness when the gaze point does not fall in the display area, and adjust the transmittance of the light-shielding lens so that the device The inner brightness is the preset threshold;

The second adjustment subunit is used to adjust the brightness of the system picture displayed on the imaging lens to the second brightness when the gaze point falls in the display area, and adjust the transmittance of the shading lens so that the The ratio of the second brightness to the brightness inside the device is kept at a preset comfort contrast;

The brightness inside the device is equal to the product of ambient light brightness and transmittance, the first brightness is equal to or less than a preset brightness threshold, and the second brightness varies with the system screen.
The device according to claim 5, wherein the first adjustment subunit is further configured to: when the gaze point does not fall in the display area and the brightness of the ambient light is lower than a preset threshold, Adjust the transmittance of the shading lens to the maximum transmittance.
The device according to claim 1, further comprising a manual adjustment unit;

The manual adjustment unit is used to manually adjust the brightness of the system image displayed on the imaging lens and/or the transmittance of the light-shielding lens.
A method for adjusting light transmittance of the device according to any one of claims 1-7, characterized in that it comprises:

Obtain the gaze point of the object's eyes;

Get ambient brightness;

Based on the point of gaze and the brightness of the ambient light, adjust the brightness of the system image displayed on the imaging lens and adjust the transmittance of the shading lens.
The method according to claim 8, wherein the imaging lens has a display area for displaying the system picture; both the shading lens and the imaging lens allow ambient light to pass through; The gaze point and the brightness of the ambient light, adjusting the brightness of the system picture on the imaging lens and adjusting the transmittance of the shading lens include:

When the gaze point does not fall in the display area, adjust the brightness of the system image on the imaging lens to be the first brightness, and adjust the transmittance of the light-shielding lens so that the brightness inside the device is a preset threshold;

When the gaze point falls in the display area, adjust the brightness of the system picture displayed on the imaging lens to be the second brightness, and adjust the transmittance of the light-shielding lens to make the ratio of the second brightness to the brightness inside the device Keep at the preset comfortable contrast;

The brightness inside the device is equal to the product of ambient light brightness and transmittance, the first brightness is equal to or less than a preset brightness threshold, and the second brightness varies with the system screen.
The method according to claim 9, further comprising:

When the gaze point does not fall in the display area and the ambient light brightness is lower than a preset threshold, the transmittance of the light-shielding lens is adjusted to a maximum transmittance.
The method according to claim 9, further comprising:

Obtain the real-time brightness of the system screen presented on the imaging lens;

judging whether the real-time brightness is equal to or less than a minimum brightness threshold;

When the real-time brightness is equal to or less than a minimum brightness threshold, manually adjust the real-time brightness based on the ambient light brightness and the real-time brightness.
The method according to claim 8, wherein said obtaining the fixation point of the subject's eyes comprises:

Obtain the gaze direction of different eyes of the object;

The gaze point is determined based on the gaze directions of the different eyes.
A light transmittance adjustment device, characterized in that it comprises:

The point of fixation acquisition module is used to obtain the point of fixation of the object's eyes;

The ambient light brightness acquisition module is used to obtain the ambient light brightness;

An adjustment module, configured to adjust the brightness of the system image displayed on the imaging lens and adjust the transmittance of the shading lens based on the point of gaze and the brightness of the ambient light.
An electronic device, characterized in that the electronic device comprises:

processor;

memory for storing said processor-executable instructions;

The processor is configured to read the executable instruction from the memory, and execute the instruction to implement the method in any one of claims 8-12 above.
A computer-readable storage medium, characterized in that the storage medium stores a computer program, and when the computer program is executed by a computer device, the computer device executes the method described in any one of claims 8-12 .