CN111399222A - Display module, display control method, storage medium, and glasses - Google Patents

Display module, display control method, storage medium, and glasses Download PDF

Info

Publication number
CN111399222A
CN111399222A CN202010265266.4A CN202010265266A CN111399222A CN 111399222 A CN111399222 A CN 111399222A CN 202010265266 A CN202010265266 A CN 202010265266A CN 111399222 A CN111399222 A CN 111399222A
Authority
CN
China
Prior art keywords
light
real environment
display
brightness
layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010265266.4A
Other languages
Chinese (zh)
Inventor
林贻鸿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202010265266.4A priority Critical patent/CN111399222A/en
Publication of CN111399222A publication Critical patent/CN111399222A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/15—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on an electrochromic effect
    • G02F1/153—Constructional details
    • G02F1/155—Electrodes
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/15—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on an electrochromic effect
    • G02F1/163—Operation of electrochromic cells, e.g. electrodeposition cells; Circuit arrangements therefor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type

Landscapes

  • Physics & Mathematics (AREA)
  • Nonlinear Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

The disclosure relates to a display assembly, a display control method, a storage medium and glasses, wherein the display assembly comprises a display unit, an adjustable euphotic layer, a scene detection unit and a control unit, and the display unit is used for displaying a virtual image; the adjustable light transmission layer is arranged on one side of the display unit far away from the display light emitting side; the scene detection unit is used for detecting the light brightness in the real environment; the control unit is respectively connected with the display unit, the adjustable euphotic layer and the scene detection unit, and is used for controlling the luminousness of the adjustable euphotic layer according to the display brightness of the virtual image and the light brightness of the real environment.

Description

Display module, display control method, storage medium, and glasses
Technical Field
The present disclosure relates to the field of electronic devices, and in particular, to a display module, a display control method, a storage medium, and glasses.
Background
Display devices are often provided in Augmented Reality (AR) apparatuses and Mixed Reality (MR) apparatuses. The display device is used for displaying a virtual scene, has a light transmission function and can enable light in a real environment to penetrate through.
At present, in the using process of the AR device and the MR device, when the display device simultaneously realizes the presentation of the virtual scene and the real environment, the problem that the brightness of the virtual scene is not matched with the brightness of the light in the display scene often exists, and then the display effect of the AR device and the MR device is poor.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The present disclosure is directed to a display module, a display control method, a storage medium, and glasses, so as to overcome, at least to some extent, the problem of poor display effects of an AR device and an MR device due to the mismatch between the brightness of a virtual scene and the brightness of light in a display scene.
According to a first aspect of the present disclosure, there is provided a display assembly comprising:
a display unit for displaying a virtual image;
the adjustable light transmission layer is arranged on one side of the display unit, which is far away from the display light-emitting side;
a scene detection unit for acquiring image data of a real environment;
and the control unit is respectively connected with the display unit, the adjustable light transmission layer and the scene detection unit, and is used for controlling the light transmission rate of the adjustable light transmission layer according to the virtual image data and the image data of the real environment.
According to a second aspect of the present disclosure, there is provided a display control method for the above display module, the display control method comprising:
acquiring image data and virtual image data of a real environment;
determining a scene of a real environment according to image data of the real environment;
and adjusting the light transmittance of the adjustable euphotic layer according to the image data of the real environment, the virtual image data and a preset scene brightness range, wherein the preset scene brightness range is the preset brightness range of the current scene of the real environment.
According to a third aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the method according to the above.
According to a fourth aspect of the present disclosure, there is provided glasses comprising the above-mentioned display assembly.
The display assembly provided by the embodiment of the disclosure detects image data of a real environment through the scene detection unit, the control unit controls the light transmittance of the adjustable light transmission layer according to the image data of the virtual image data and the image data of the real environment, the adjustment of the brightness of light penetrating through the display assembly is realized through the adjustable light transmission layer, and then the problem that the display effect of the AR equipment and the MR equipment is poor due to the fact that the brightness of the virtual scene is not matched with the brightness of the light in the display scene is overcome at least to a certain extent, and the display effect of the AR equipment and the MR equipment is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
Fig. 1 is a schematic structural diagram of a first display assembly according to an exemplary embodiment of the present disclosure.
Fig. 2 is a schematic block diagram of a first display assembly provided in an exemplary embodiment of the present disclosure.
Fig. 3 is a schematic structural diagram of a first display unit according to an exemplary embodiment of the present disclosure.
Fig. 4 is a schematic structural diagram of a second display assembly according to an exemplary embodiment of the present disclosure.
Fig. 5 is a schematic structural diagram of a third display assembly provided in an exemplary embodiment of the present disclosure.
Fig. 6 is a schematic diagram of a first electrode according to an exemplary embodiment of the disclosure.
Fig. 7 is a schematic block diagram of a second display assembly provided in an exemplary embodiment of the present disclosure.
Fig. 8 is a schematic structural diagram of a fourth display assembly according to an exemplary embodiment of the disclosure.
Fig. 9 is a flowchart of a first display control method according to an exemplary embodiment of the present disclosure.
Fig. 10 is a schematic diagram of a first computer-readable storage medium according to an exemplary embodiment of the disclosure.
Fig. 11 is a schematic view of glasses according to an exemplary embodiment of the present disclosure.
In the figure:
110. a display unit; 111. an optical waveguide; 112. an image light source; 120. an adjustable light transmission layer; 121. a first electrode layer; 1211. a first electrode unit; 122. an electrochromic layer; 123. a second electrode layer; 124. a liquid crystal layer; 130. a scene detection unit; 131. a light sensor; 140. a control unit; 141. a controller; 142. an adjustment drive circuit; 100. a display component; 200. a spectacle leg; 300. a frame body.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar structures, and thus their detailed description will be omitted.
Although relative terms, such as "upper" and "lower," may be used in this specification to describe one element of an icon relative to another, these terms are used in this specification for convenience only, e.g., in accordance with the orientation of the examples described in the figures. It will be appreciated that if the device of the icon were turned upside down, the element described as "upper" would become the element "lower". When a structure is "on" another structure, it may mean that the structure is integrally formed with the other structure, or that the structure is "directly" disposed on the other structure, or that the structure is "indirectly" disposed on the other structure via another structure.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the embodiments of the disclosure can be practiced without one or more of the specific details, or with other methods, components, materials, devices, steps, and so forth. In other instances, well-known structures, methods, devices, implementations, materials, or operations are not shown or described in detail to avoid obscuring aspects of the disclosure.
First, in the present exemplary embodiment, there is provided a display assembly, as shown in fig. 1 and 2, including: the display device comprises a display unit 110, an adjustable light-transmitting layer 120, a scene detection unit 130 and a control unit 140, wherein the display unit 110 is used for displaying a virtual image; the adjustable transparent layer 120 is disposed on a side of the display unit 110 away from the display light emitting side; scene detection unit 130 the scene detection unit is configured to obtain image data of a real environment; the control unit 140 is respectively connected to the display unit 110, the adjustable transparent layer 120 and the scene detection unit 130, and the control unit 140 is configured to control the light transmittance of the adjustable transparent layer 120 according to the virtual image data and the image data of the real environment.
According to the display assembly provided by the embodiment of the disclosure, the scene detection unit 130 detects image data in a real environment, the control unit 140 controls the light transmittance of the adjustable light transmitting layer 120 according to the virtual image data and the image data in the real environment, and the adjustable light transmitting layer 120 realizes the adjustment of the brightness of light passing through the display assembly, so that the problem of poor display effect of the AR device and the MR device due to the fact that the brightness of the virtual scene is not matched with the brightness of the light in the display scene is solved to a certain extent at least, and the display effects of the AR device and the MR device are improved.
The following will describe portions of the display assembly provided by the embodiments of the present disclosure in detail:
the display mode of the display unit 110 provided by the embodiment of the present disclosure is an optical see-through type, and a user can observe an external real environment through the display unit 110, and simultaneously, a virtual scene is transmitted to eyes of the user through an optical structure of the display unit 110.
The display unit 110 may be an optical waveguide 111, as shown in fig. 3, the display unit 110 may include an optical waveguide 111 and an image light source 112, the optical waveguide 111 and the adjustable light-transmitting layer 120 being arranged in parallel; the image light source 112 is connected to the optical waveguide 111, and the image light transmitted from the image light source 112 forms a virtual image through the optical waveguide 111.
The optical waveguide 111 may be a piece of holographic optical waveguide 111, and the holographic optical waveguide 111 makes parallel light of different field angles enter the waveguide through total reflection and makes incident light propagate along the waveguide structure in a first direction. The light of a single field of view enters the glass plate of the optical waveguide 111 through a glass prism, and the incident angle of the light on the glass plate is larger than the maximum total reflection critical angle of the glass plate, so that the light propagates in the optical waveguide 111 in a total reflection manner.
A holographic grating may be incorporated into the waveguide, and the parallel light within the waveguide will be diffracted when it enters the holographic grating. The vector direction angle of the complex amplitude of the light passing through the holographic grating can be controlled such that a portion of the light passing through the holographic grating at a time is diffracted at a fixed angle and exits the waveguide through the holographic grating. The light that is not diffracted continues to propagate in the glass substrate, which can reduce the loss of light energy and can be subject to exit pupil expansion. Or the diffraction efficiency of the holographic grating can be controlled to make the light intensity of the light transmitted through the holographic grating the same each time, for example, only one tenth of the light intensity is emitted each time, so that the diffraction efficiency of the manufactured holographic grating is 10%. This makes the display unit 110 emit light uniformly, and a soft image is obtained after the exit pupil expansion.
When the holographic grating is used for coupling, the diffraction angle of the holographic grating at the coupling position is the same as that of the holographic grating in the waveguide, so that the incident angle when the holographic grating is incident into the waveguide and the emergent angle when the holographic grating is emergent out of the waveguide can be ensured to be the same, and the field angle of the system is the same as that of the collimating mirror. The addition of the holographic grating does not affect the observation of the real scene by the user.
The image light source 112 is connected to the optical waveguide 111, and the image light source 112 emits light to the optical waveguide 111 according to the virtual image to be displayed by the display unit 110, and the light passes through the optical waveguide 111 and then is transmitted to the pupil of the user, thereby displaying the virtual scene. For example, the image light source 112 may be disposed at one end of the light guide 111, and the direction in which light of the image light source 112 exits is perpendicular to the surface of the light guide 111. The light emitted from the image light source 112 perpendicularly irradiates the optical waveguide 111, and is emitted at the pupil of the user through the total reflection of the optical waveguide 111, so as to display the virtual scene.
As shown in fig. 4, the adjustable light-transmitting layer 120 includes: the display device comprises a first electrode layer 121, an electrochromic layer 122 and a second electrode layer 123, wherein the first electrode layer 121 is arranged on one side of the display unit 110 far away from the display light-emitting side; the electrochromic layer 122 is disposed on a side of the first electrode layer 121 away from the display unit 110; the second electrode layer 123 is disposed on a side of the electrochromic layer 122 away from the first electrode layer 121. The light transmittance of the electrochromic layer 122 is adjusted by an electric field formed by the first electrode layer 121 and the second electrode layer 123.
The electrochromic layer 122 may include: the display unit comprises an electrochromic material layer, an electrolyte layer and an ion storage layer, wherein the electrochromic material layer is arranged on one side of the first electrode, which is far away from the display unit 110; the electrolyte layer is arranged on one side of the electrochromic material layer, which is far away from the first electrode, and is used for conveying charged ions; the ion storage layer is arranged on one side of the electrolyte layer far away from the electrochromic material layer and is used for storing charged ions.
In practical applications, of course, the electrochromic material layer, the electrolyte layer and the ion storage layer may be arranged between the first electrode layer 121 and the second electrode layer 123 in this order, the electrochromic material layer is disposed on a side of the second electrode layer 123 close to the display unit 110, the electrolyte layer is disposed on a side of the electrochromic material layer close to the display unit 110, and the ion storage layer is disposed on a side of the electrolyte layer close to the display unit 110.
Ion(s)The charged ions stored in the memory layer pass through the electrolyte layer and enter the electrochromic material layer in an electric field formed by the first electrode and the like and the second electrode layer 123 after being electrified, so that the color of the electrochromic material layer is changed. For example, the material of the electrochromic material layer is tungsten oxide (WO)3) In the ion storage layer, lithium ions are stored, and the lithium ions enter WO through the electrolyte layer 232 under the action of an electric field3Layer of tungsten bronze L iWO3-xResult in W6+Is reduced to low-priced W5+Electrons from W6+To W5+The interband transition of (a) absorbs the photon and causes the color change.
The first electrode layer 121 may be a cathode, on which basis the material of the electrochromic material layer may be a cathodic electrochromic material, the material of the electrochromic material layer comprising one or more of group VIB metal oxides. Such as tungsten oxide, molybdenum oxide, chromium oxide, and the like.
It is understood that the first electrode layer 121 may also be an anode, and the material of the electrochromic material layer includes one or more of a group viii metal oxide and a group Pt metal oxide or hydrate. Such as nickel oxide, iridium oxide, cobalt oxide, rhodium oxide, manganese oxide, and the like.
Of course, in practical application, the electrochromic material layer may also be an organic electrochromic film. The organic electrochromic film has a relatively large variety and can be divided into two main categories of organic micromolecular electrochromic materials and conductive polymer electrochromic materials. Under the action of an electric field, the conductive polymer in the organic electrochromic film is doped, and the doping process of the conductive polymer is a redox reversible process. In the doping process, transition between a molecular conduction band and a valence band is initiated, wherein the transition comprises transition of different energy levels of a polaron energy level, a soliton energy level, a bipolar energy level and an electron, and the spectrum is changed differently. The doping degree is determined by controlling the voltage in a certain range, so that the absorption of a visible light region is different, the color and brightness are changed, and the electrochromic phenomenon is generated.
The material of the electrolyte layer may include one or more of a liquid electrolyte material, a gel state electrolyte material, and a solid state electrolyte material, the electrolyte is a transparent layer, and a transparent gel state electrolyte material may be selected as the electrolyte layer material. Such as polyethylene oxide, polymethyl methacrylate, polyacrylonitrile, polyvinylidene fluoride, and the like. Since the gel-state electrolyte has high ionic conductivity, the response speed of the adjustable light transmitting layer 120 can be improved.
It is understood that, as shown in fig. 5, the light-adjustable layer 120 may also include a first electrode layer 121, a liquid crystal layer 124, and a second electrode layer 123, where the first electrode layer 121 is disposed on a side of the display unit 110 away from the display light-emitting side; the electro-liquid crystal layer 124 is arranged on one side of the first electrode layer 121 far away from the display unit 110; the second electrode layer 123 is disposed on a side of the liquid crystal layer 124 away from the first electrode layer 121.
A spacer may be disposed between the first electrode layer 121 and the second electrode layer 123, and the spacer may maintain a predetermined distance between the first electrode layer 121 and the second electrode layer 123 and form a liquid crystal cell. The liquid crystal is filled in the liquid crystal cell to form a liquid crystal layer 124. When the display component is used, the electric field formed by the first electrode layer 121 and the second electrode layer 123 drives the liquid crystal to deflect, and thus the light transmittance of the display component is adjusted.
The first electrode layer 121 and the second electrode layer 123 may be transparent electrodes, for example, ITO thin films. The material of the first electrode layer 121 may include one or more of silver, chromium, black chromium, ruthenium, stainless steel, titanium, nickel, molybdenum, nickel-chromium, inconel, indium, palladium, osmium, cobalt, cadmium, niobium, brass, bronze, tungsten, rhenium, iridium, aluminum alloy, scandium, yttrium, zirconium, vanadium, manganese, iron, zinc, tin, lead, bismuth, antimony, rhodium, tantalum, copper, gold, platinum group metals, and other suitable reflective materials, preferably one or more of copper, gold, platinum, aluminum alloy, chromium, nickel, ruthenium, silver alloy. The material of the second electrode layer 123 may include one or more of silver, chromium, black chromium, ruthenium, stainless steel, titanium, nickel, molybdenum, nickel-chromium, inconel, indium, palladium, osmium, cobalt, cadmium, niobium, brass, bronze, tungsten, rhenium, iridium, aluminum alloy, scandium, yttrium, zirconium, vanadium, manganese, iron, zinc, tin, lead, bismuth, antimony, rhodium, tantalum, copper, gold, platinum group metals, and other suitable reflective materials, preferably one or more of copper, gold, platinum, aluminum alloy, chromium, nickel, ruthenium, silver, and silver alloy, which are not limited in this disclosure.
The first electrode layer 121 provided by the embodiment of the present disclosure may be a monolithic structure or a split structure, and the second electrode layer 123 may also be a monolithic structure or a split structure. The first electrode layer 121 and the second electrode layer 123 may both be of a monolithic structure, or any one of the first electrode layer 121 and the second electrode layer 123 may be of a split structure.
For example, as shown in fig. 6, the first electrode layer 121 may include a plurality of first electrode units 1211, the plurality of first electrode units 1211 are distributed on the surface of the display unit 110, and the plurality of first electrode units 1211 are insulated from each other. The first electrode 1211 may have a rectangular structure, and a plurality of the first electrode 1211 is arranged in an array. Of course, in practical applications, the second electrode layer 123 may also include a plurality of second electrode units, and the plurality of second electrode units are distributed on the surface of the display unit 110 and are insulated from each other. The second electrode unit may have a rectangular structure, and a plurality of second electrode units are arranged in an array.
The first electrode layer 121 or the second electrode layer 123 is arranged to be of a split structure, so that the brightness of the display area corresponding to each electrode unit can be controlled respectively, and the display assembly is favorable for application in different scenes.
As shown in fig. 7, the control unit 140 may include a controller 141 and an adjustment driving circuit 142, the controller 141 being connected to the display unit 110 and the scene detection unit 130, respectively; the adjusting driving circuit 142 is respectively connected to the controller 141 and the first electrode, the controller 141 determines a target light transmittance of the adjustable light-transmitting layer 120 according to the virtual image data and the image data of the real environment, outputs a control signal according to the target light transmittance of the adjustable light-transmitting layer 120, and the adjusting driving circuit 142 adjusts the light transmittance of the adjustable light-transmitting layer 120 according to the control signal.
The controller 141 is configured to obtain the brightness of the virtual image displayed by the display unit 110 and obtain the detection result of the scene detection unit 130. The luminance of the virtual image acquired by the controller 141 may be obtained by acquiring a gray scale of the virtual image displayed by the display unit 110. Or the controller 141 may determine the brightness of the virtual image by acquiring an electric signal in a driving circuit of the display unit 110.
After the brightness of the virtual image and the brightness of the light in the real environment are obtained, the controller 141 determines the target light transmittance of the adjustable light-transmitting layer 120 according to the brightness of the virtual image and the brightness of the light in the real environment, determines the electric fields loaded on the first electrode layer 121 and the second electrode layer 123 according to the target light transmittance, and then adjusts the light transmittance of the adjustable light-transmitting layer 120 to be the target light transmittance.
The adjustment drive circuit 142 is connected to the first electrode, the second electrode is connected to a power source of a fixed potential, and the electric field between the first electrode layer 121 and the second electrode layer 123 is adjusted by the adjustment drive circuit 142. When the first electrode layer 121 includes a plurality of first electrode units 1211, each of the first electrode units 1211 is connected to a corresponding adjustment driving circuit 142. The adjusting driving circuit 142 may be disposed on a frame of the display assembly, or the display assembly may include a driving circuit layer, the driving circuit layer may be disposed between the display unit 110 and the first electrode layer 121, and the adjusting driving circuit 142 is disposed on the driving circuit layer.
When the light transmittance of the adjustable light-transmitting layer 120 is adjusted, the brightness of the external light transmitted through the adjustable light-transmitting layer 120 may be detected, and whether the brightness of the light is matched with a preset brightness threshold value is determined; when the light brightness is not matched with the preset brightness threshold, the light transmittance of the adjustable light-transmitting layer 120 is adjusted. The preset brightness threshold value can be a determined value and is stored in a storage device of the display component; or the preset brightness threshold may be a value related to the brightness of the virtual image, for example, the preset threshold may be a function of the brightness value of the virtual image.
The scene detection unit 130 may include a light detection subunit 131 and an image acquisition subunit 132, and the image acquisition subunit 132 is connected to the control unit 140 for acquiring an image of the real environment. The image capturing subunit 132 may be a camera, which may be disposed on the display unit 110, or a camera may be disposed on the glasses legs, etc. The camera acquires an image of the real environment, and transmits the image of the real environment to the controller 141, and the controller 141 determines the current scene of the real environment according to the image acquired by the camera. For example, the real scene is day or night, and sunny or cloudy. Different real environment scenes correspond to different brightness threshold ranges, for example, the maximum brightness in the daytime cannot be smaller than a specified threshold. When the light transmittance of the adjustable light-transmitting layer is adjusted, it is necessary to ensure that the light rays penetrating through the adjustable light-transmitting layer are within the corresponding brightness threshold range.
The light detecting subunit 131 includes a light sensor, which collects light signals in the real environment and converts the light signals into electrical signals, and the light sensor transmits the electrical signals to the control unit 140. The light sensor is disposed on the display unit 110, and the adjustable transparent layer 120 covers a light inlet portion of the light sensor, so that light in a real environment enters the light sensor through the adjustable transparent layer 120.
The light sensor may be disposed at an end portion of the display unit, for example, an upper end or a lower end, etc. The adjustable transparent layer covers the display unit 110 and the light sensor, and at this time, the light collected by the light sensor is the light passing through the adjustable transparent layer 120. The light transmittance of the adjustable light-transmitting layer 120 is adjusted according to the relationship between the light passing through the adjustable light-transmitting layer 120 and a preset threshold.
Or the light sensor is disposed on the adjustable transparent layer 120, and the light inlet portion of the light sensor is used for collecting light in the real environment. At this time, the light sensor extends out of the adjustable light-transmitting layer 120 to directly collect light in the real environment.
As shown in fig. 8, the light inlet portion of the light sensor is exposed to the adjustable light-transmitting layer 120. For example, the light sensor may be disposed at an end portion of the display unit 110, for example, an upper end or a lower end, etc. The light sensor may have a through hole at a projection portion of the adjustable light-transmitting layer 120, so that external light directly enters the light sensor. A transparent material may be filled in the through hole to protect the light sensor. Or the light sensor may be disposed on the upper side or the lower side of the adjustable light-transmitting layer 120, that is, the adjustable light-transmitting layer 120 is not disposed at the position of the light sensor.
The display assembly provided by the embodiment of the disclosure detects the light intensity in the real environment through the scene detection unit 130, the control unit 140 controls the light transmittance of the adjustable light transmitting layer 120 according to the image data and the virtual image data in the real environment, and the adjustment of the brightness of the light transmitted through the display assembly is realized through the adjustable light transmitting layer 120, so that the problem of poor display effect of the AR device and the MR device due to the fact that the brightness of the virtual scene is not matched with the brightness of the light in the display scene is overcome at least to a certain extent, and the display effects of the AR device and the MR device are improved.
The exemplary embodiment of the present disclosure also provides a display control method for the display assembly described above, as shown in fig. 9, the display control method may include the steps of:
in step S910, image data of a real environment and virtual image data are acquired.
Step S930 determines a scene of the real environment from the image data of the real environment.
Step S950, adjusting the light transmittance of the adjustable light-transmitting layer according to the image data of the real environment, the virtual image data and the preset scene brightness range, wherein the preset scene brightness range is the preset brightness range of the current scene of the real environment.
According to the display control method provided by the embodiment of the disclosure, the image data of the real environment is detected through light, the light transmittance of the adjustable light transmitting layer 120 is controlled according to the image data and the virtual image data in the real environment, and the brightness of the light transmitting the display assembly is adjusted through the adjustable light transmitting layer 120, so that the problem of poor display effect of the AR device and the MR device due to the fact that the brightness of the virtual scene is not matched with the brightness of the light in the display scene is solved at least to a certain extent, and the display effect of the AR device and the MR device is improved.
In step S910, image data of a real environment and virtual image data may be acquired.
The image data of the real environment can be acquired to acquire the image of the real environment and to acquire the light brightness in the real environment. The real environment image acquisition can be realized through the camera. The light intensity in the real environment can be acquired by the light sensor. The light sensor may directly detect the brightness of the real environment in the displayed scene, or the light sensor may obtain the light of the real environment passing through the adjustable light-transmitting layer 120. In practical applications, the image data of the real environment may be acquired at preset time intervals, for example, at intervals of 1 second, 3 seconds, 5 seconds, or 1 minute.
The brightness of the acquired virtual image may be obtained by acquiring a gray scale of the virtual image displayed by the display unit 110. Or the brightness of the virtual image may be determined by acquiring an electrical signal in a driving circuit of the display unit 110.
In step S930, a scene of the real environment may be determined from the image data of the real environment.
The real environment may include a variety of scenes, such as night, day, cloudy day, sunny day, indoors and outdoors, etc. The brightness ranges corresponding to different environmental scenes are different. In order to avoid that the light transmitted through the adjustable light-transmitting layer does not exceed the preset range of the scene when the adjustable light-transmitting layer is adjusted, the scene of the real environment needs to be determined.
The image of the real environment can be collected through the camera, and the image of the real environment is transmitted to the controller 141, and the controller 141 judges the scene of the current real environment according to the image collected by the camera. For example, the real scene is day, night, sunny day or cloudy day. Different real environment scenes correspond to different brightness threshold ranges, for example, the maximum brightness in the daytime cannot be smaller than a specified threshold. In practical application, a scene preset brightness range corresponding to a scene in a real environment can be stored in a storage device of a display device as a mapping, and when the light transmittance of the adjustable light-transmitting layer is adjusted, the stored mapping is called to determine the scene preset brightness range.
In step S950, the light transmittance of the adjustable light-transmitting layer may be adjusted according to the image data of the real environment, the virtual image data, and the preset brightness range of the scene of the real environment.
The adjustment of the light transmittance of the adjustable light-transmitting layer can be realized by the following steps: determining the difference value between the brightness of the virtual image and the brightness of the light in the real environment; when the absolute value of the difference value between the brightness of the virtual image and the brightness of the light in the real environment is larger than a preset threshold value, determining the brightness of the target real environment so that the difference value between the brightness of the virtual image and the brightness of the target real environment is smaller than or equal to the preset threshold value; when the brightness of the target real environment is within the preset brightness range of the scene, adjusting the light transmittance of the adjustable light-transmitting layer to enable the brightness of the light of the real environment penetrating through the adjustable light-transmitting layer to be the brightness of the target real environment; when the brightness of the target real environment is outside the preset brightness range of the scene, the light transmittance of the adjustable light transmission layer is adjusted, so that the brightness of the light of the real environment penetrating through the adjustable light transmission layer is a first boundary value of the preset brightness range of the scene, and the first boundary value is a boundary value of the preset brightness range of the scene close to the brightness of the target real environment.
When the absolute value of the difference between the brightness of the virtual image and the brightness of the light in the real environment is greater than a preset threshold, discomfort of the eyes of the user may be caused, and specifically, the determination of the preset threshold may be obtained through experiments or experience. And when the absolute value of the difference value between the brightness of the virtual image and the brightness of the light in the real environment is less than or equal to a preset threshold value, the light transmittance of the adjustable light-transmitting layer is not adjusted.
When the light transmittance of the adjustable light transmission layer is adjusted, the scene of the real environment needs to be considered, and the distortion of the scene of the real environment is avoided after the adjustable light transmission layer is adjusted. Therefore, when the adjustable light-transmitting layer is adjusted, when the display environment light rays passing through the adjustable light-transmitting layer are within the preset brightness range of the scene, the adjustment is considered to have no problem; when the display environment light passing through the adjustable light transmission layer is located outside the preset scene brightness range, correction is needed, so that the light transmission brightness of the adjusted adjustable light transmission layer is located at the limit of the preset scene brightness range, partial difference between the brightness of the virtual image and the brightness of the display light is solved, and distortion of the real environment scene is avoided.
When the brightness of the light in the real environment is greater than the preset threshold value of the brightness of the virtual image, the light transmittance of the adjustable light-transmitting layer 120 is reduced; when the brightness of the light in the real environment is smaller than the preset threshold of the brightness of the virtual image, the light transmittance of the adjustable light-transmitting layer 120 is increased.
According to the display control method provided by the embodiment of the disclosure, the light intensity in the real environment is detected through light, the light transmittance of the adjustable light transmitting layer 120 is controlled according to the brightness of the light in the real environment and the brightness of the virtual image, and the brightness of the light transmitting the display assembly is adjusted through the adjustable light transmitting layer 120, so that the problem that the display effect of the AR device and the MR device is poor due to the fact that the brightness of the virtual scene is not matched with the brightness of the light in the display scene is solved to a certain extent at least, and the display effect of the AR device and the MR device is improved.
It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.
In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the invention described in the above-mentioned "exemplary methods" section of the present description, when said program product is run on the terminal device.
Referring to fig. 10, a program product 1100 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including AN object oriented programming language such as Java, C + +, or the like, as well as conventional procedural programming languages, such as the "C" language or similar programming languages.
Exemplary embodiments of the present disclosure also provide glasses, which may include the above-described display assembly, as shown in fig. 11.
Further, the glasses may further include a frame 300 and a glasses leg 200, and the display module 100 is disposed on the frame 300; the temple 200 is connected to the frame 300, and the temple 200 is rotatable with respect to the frame 300.
It should be noted that the glasses provided by the embodiments of the present disclosure may be AR glasses or MR glasses, and the adjustable light-transmitting layer is disposed on the side of the glasses away from the user, so that the brightness of the light entering the real environment of the glasses can be adjusted, and the brightness of the real scene and the virtual scene is balanced.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims (14)

1. A display assembly, the display assembly comprising:
a display unit for displaying a virtual image;
the adjustable light transmission layer is arranged on one side of the display unit, which is far away from the display light-emitting side;
a scene detection unit for acquiring image data of a real environment;
and the control unit is respectively connected with the display unit, the adjustable light transmission layer and the scene detection unit, and is used for controlling the light transmission rate of the adjustable light transmission layer according to the virtual image data and the image data of the real environment.
2. The display assembly of claim 1, wherein the adjustable light transmission layer comprises:
the first electrode layer is arranged on one side, far away from the display light-emitting side, of the display unit;
the electrochromic layer is arranged on one side, far away from the display unit, of the first electrode layer;
the second electrode layer is arranged on one side, far away from the first electrode layer, of the electrochromic layer.
3. The display assembly of claim 1, wherein the adjustable light transmission layer comprises:
the first electrode layer is arranged on one side, far away from the display light-emitting side, of the display unit;
the liquid crystal layer is arranged on one side, far away from the display unit, of the first electrode layer;
and the second electrode layer is arranged on one side of the liquid crystal layer, which is far away from the first electrode layer.
4. A display element as claimed in claim 2 or 3, wherein the first electrode layer comprises:
the display unit comprises a plurality of first electrode units, wherein the first electrode units are distributed on the surface of the display unit and are insulated from each other.
5. The display assembly of claim 4, wherein the control unit comprises:
the controller is respectively connected with the display unit and the scene detection unit;
the adjusting driving circuit is respectively connected with the controller and the first electrode layer, the controller determines the target light transmittance of the adjustable light-transmitting layer according to the virtual image data and the image data of the real environment and outputs a control signal according to the target light transmittance of the adjustable light-transmitting layer, and the adjusting driving circuit adjusts the light transmittance of the adjustable light-transmitting layer according to the control signal.
6. The display assembly of claim 1, wherein the display unit comprises:
the optical waveguide sheet is arranged in parallel with the adjustable light-transmitting layer;
and the image light source is connected with the optical waveguide sheet, and image light rays sent by the image light source form a virtual image through the optical waveguide sheet.
7. The display assembly of claim 1, wherein the scene detection unit comprises:
the image acquisition subunit is connected with the control unit and is used for acquiring images of a real environment;
and the light detection subunit is connected with the control unit and used for detecting the light intensity in the real environment.
8. The display assembly of claim 7, wherein the light detection subunit comprises:
the light sensor is arranged on the display unit, and the adjustable light transmission layer covers the light inlet part of the light sensor, so that light in the real environment enters the light sensor through the adjustable light transmission layer.
9. The display assembly of claim 7, wherein the light detection subunit comprises:
and the light sensor is arranged on the adjustable light transmission layer, and the light inlet part of the light sensor is used for collecting light rays of the real environment.
10. A display control method for a display module according to any one of claims 1 to 9, the display control method comprising:
acquiring image data and virtual image data of a real environment;
determining a scene of a real environment according to image data of the real environment;
and adjusting the light transmittance of the adjustable light transmission layer according to the image data of the real environment, the virtual image data and a preset scene brightness range, wherein the preset scene brightness range is a preset brightness range corresponding to the current scene of the real environment.
11. The display control method according to claim 9, wherein the adjusting the light transmittance of the adjustable light-transmitting layer according to the image data of the real environment, the virtual image data, and the preset brightness range of the scene of the real environment comprises:
determining a difference value between the brightness of the virtual image and the brightness of light in the real environment;
when the absolute value of the difference value between the brightness of the virtual image and the brightness of the light in the real environment is larger than a preset threshold value, determining the brightness of the target real environment, so that the difference value between the brightness of the virtual image and the brightness of the target real environment is smaller than or equal to the preset threshold value;
when the target real environment brightness is within the preset scene brightness range, adjusting the light transmittance of an adjustable light-transmitting layer to enable the light brightness of the real environment penetrating through the adjustable light-transmitting layer to be the target real environment brightness;
when the target real environment brightness is located outside the preset scene brightness range, the light transmittance of the adjustable light transmission layer is adjusted, so that the light brightness of the real environment penetrating through the adjustable light transmission layer is a first boundary value of the preset scene brightness range, and the first boundary value is a boundary value of the preset scene brightness range close to the target real environment brightness side.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to claim 10 or 11.
13. Eyewear, wherein the eyewear comprises a display assembly of any of claims 1-9.
14. The eyewear of claim 13, further comprising:
the frame body is provided with the display assembly;
the glasses legs are connected with the frame body and can rotate relative to the frame body.
CN202010265266.4A 2020-04-07 2020-04-07 Display module, display control method, storage medium, and glasses Pending CN111399222A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010265266.4A CN111399222A (en) 2020-04-07 2020-04-07 Display module, display control method, storage medium, and glasses

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010265266.4A CN111399222A (en) 2020-04-07 2020-04-07 Display module, display control method, storage medium, and glasses

Publications (1)

Publication Number Publication Date
CN111399222A true CN111399222A (en) 2020-07-10

Family

ID=71431491

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010265266.4A Pending CN111399222A (en) 2020-04-07 2020-04-07 Display module, display control method, storage medium, and glasses

Country Status (1)

Country Link
CN (1) CN111399222A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111930236A (en) * 2020-08-17 2020-11-13 Oppo广东移动通信有限公司 Device control method, device, storage medium and electronic device
CN112946896A (en) * 2021-02-03 2021-06-11 上海闻泰信息技术有限公司 Wearable device, transmittance adjustment system, method, and readable storage medium
CN113552942A (en) * 2021-07-14 2021-10-26 海信视像科技股份有限公司 Method and equipment for displaying virtual object based on illumination intensity
CN114967220A (en) * 2022-08-02 2022-08-30 中国电子科技集团公司信息科学研究院 AR lens, preparation method, AR glasses and AR system

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111930236A (en) * 2020-08-17 2020-11-13 Oppo广东移动通信有限公司 Device control method, device, storage medium and electronic device
CN112946896A (en) * 2021-02-03 2021-06-11 上海闻泰信息技术有限公司 Wearable device, transmittance adjustment system, method, and readable storage medium
CN113552942A (en) * 2021-07-14 2021-10-26 海信视像科技股份有限公司 Method and equipment for displaying virtual object based on illumination intensity
CN114967220A (en) * 2022-08-02 2022-08-30 中国电子科技集团公司信息科学研究院 AR lens, preparation method, AR glasses and AR system
CN114967220B (en) * 2022-08-02 2022-10-25 中国电子科技集团公司信息科学研究院 AR (augmented reality) lens, preparation method, AR glasses and AR system

Similar Documents

Publication Publication Date Title
CN111399222A (en) Display module, display control method, storage medium, and glasses
CN212135067U (en) Display assembly and glasses
US20200150440A1 (en) Wearable display apparatus having a light guide element that guides light from a display element and light from an outside
US10054725B2 (en) Electroactive lens with multiple depth diffractive structures
US20210286201A1 (en) Optical devices, systems, and methods
KR20140052294A (en) Method for providing user with virtual image in head-mounted display device, machine-readable storage medium and head-mounted display device
CN110537136A (en) Optical devices, image display device and display device
Liu et al. Liquid prism for beam tracking and steering
EP3680702A1 (en) Wearable display apparatus
US20160132163A1 (en) Touch module and mobile terminal
CN110049255A (en) Iris diaphgram and control method
US20120176660A1 (en) Electrochromic device and storage device and manufacturing method thereof
US6535323B2 (en) Light-switching device
US10488700B2 (en) Electrical polarization filter, electronic apparatus including the same, and method of operating the electronic apparatus
CN115586643A (en) Wearable display device, transmittance adjustment method, device, apparatus, and medium
CN109165492B (en) Device control method, device, storage medium and electronic device
CN211149076U (en) Electrochromic AR lens and AR glasses
CN111830718B (en) Augmented reality device
US9835930B2 (en) Auto focus device and method for liquid crystal display
CN211149077U (en) Acoustic control AR lens and AR glasses that discolour
CN108803863B (en) Brain control wearable display device and brain control display method
CN113075809A (en) Display device
JP2007248985A (en) Liquid crystal lens and electronic equipment
KR20190070899A (en) Method for providing user with virtual image in head-mounted display device, machine-readable storage medium and head-mounted display device
CN207114927U (en) Glasses system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination