WO2022206638A1

WO2022206638A1 - Augmented reality device and display method thereof

Info

Publication number: WO2022206638A1
Application number: PCT/CN2022/083226
Authority: WO
Inventors: 朱帅帅
Original assignee: 华为技术有限公司
Priority date: 2021-03-31
Filing date: 2022-03-26
Publication date: 2022-10-06
Also published as: CN115145028A

Abstract

An augmented reality device (100), comprising a frame (10), a combiner (31), an active shutter lens (33), an image projector (32) and a processor (34). The combiner (31) is mounted on the frame (10), the active shutter lens (33) is mounted on an outer side of the combiner (31) and covers a tunable grating (316) of the combiner (31), and the image projector (32) is mounted on the frame (10) for alternately performing a first operation and a second operation. The first operation comprises turning on the image projector (32), adjusting the tunable grating (316) to a first state, and adjusting the active shutter lens (33) to a second state, wherein the image projector (32) projects display light (L0) to the combiner (31), the display light (L0) is diffracted at the tunable grating (316) to form diffracted light, part of the diffracted light is directed to an inner side of the combiner (31), and the active shutter lens (33) blocks ambient light (Lc) directed to the tunable grating (316). The second operation comprises turning off the image projector (32), adjusting the tunable grating (316) to a third state, and adjusting the active shutter lens (33) to a fourth state, wherein the ambient light (Lc) passes through the active shutter lens (33) and the tunable grating (316) and is then directed to the inner side of the combiner (31).

Description

Augmented reality device and display method thereof

This application claims the priority of the Chinese patent application with the application number 202110350866.5 and the application title "Augmented Reality Device and Display Method", which was filed with the China Patent Office on March 31, 2021, the entire contents of which are incorporated into this application by reference .

technical field

The present application relates to the field of display combining virtual and reality, and in particular, to an augmented reality device and a display method thereof.

Background technique

Augmented reality (AR) technology, the principle of which is to use a computer-controlled image projector to project the display light carrying digital content into the human eye to form a virtual scene, and to combine the virtual scene with the outside world that the human eye can directly see. The real scene is superimposed, so that the human eye can see the image information combined with the virtual scene and the real scene in the outside world.

In traditional augmented reality devices, when ambient light enters the human eye through the out-coupling grating, light of different wavelengths will diffract at the out-coupling grating due to the diffraction effect of the out-coupling grating, and light of various colors will enter the human eye. It causes a rainbow effect (rainbow effect), which reduces the user's experience.

SUMMARY OF THE INVENTION

The present application provides an augmented reality device and a display method thereof, which are used to eliminate the rainbow effect and improve the user experience.

In a first aspect, the present application provides an augmented reality device, including a frame, a combiner, an active shutter lens, an image projector, and a processor, the combiner is mounted on the frame, the combiner includes a tunable grating, and the active shutter lens is mounted on the frame. The outside of the combiner covers the tunable grating, the image projector is mounted on the frame, and the processor couples the tunable grating, the image projector and the active shutter lens for alternately performing the first operation and the second operation.

The first operation includes turning on the image projector, adjusting the tunable grating to a first state, and adjusting the active shutter lens to a second state.

At this time, the image projector projects display light to the combiner. The display light is light carrying digital content. The display light is diffracted at the tunable grating to form diffracted light, part of the diffracted light is directed to the inside of the combiner, and part of the diffracted light is directed to the outside of the combiner. The diffracted light on the outside of the device passes through the active shutter lens and is directed to the external environment, preventing the diffracted light carrying digital content from leaking out. The light forms a small display window on the surface of the augmented reality device, improving the appearance of the user when using the augmented reality device.

In addition, the active shutter lens blocks the ambient light directed to the tunable grating, prevents the ambient light directed to the tunable grating from diffracting at the tunable grating, avoids the rainbow effect caused by light of various colors entering the human eye, and improves the user's safety. Use experience.

The second operation includes turning off the image projector, adjusting the tunable grating to a third state, and adjusting the active shutter glass to a fourth state.

At this time, the image projector does not project display light to the combiner. After the ambient light passes through the active shutter lens and the tunable grating, it is directed to the inside of the combiner, so that the user can see the real scene outside through the combiner and the active shutter glass, so as to ensure that the augmented reality device has a certain transmittance.

The inner side of the coupler refers to the surface of the coupler facing the user when the augmented reality device is worn on the user's head. That is, the inner side of the adapter is the side of the adapter facing the human eye. That is, the human eye is located inside the coupler. Similarly, the outer side of the coupler refers to the side of the coupler that faces away from the user when the augmented reality device is worn on the user's head. That is, the outside of the coupler is the side of the coupler that faces away from the human eye. That is, the outside of the coupler is the side of the coupler facing the outside.

Among them, a tunable grating is an optical device that can be switched on and off under the control of a processor. The processor turns on the tunable grating, that is, when the tunable grating is in the first state, the tunable grating is equivalent to a diffraction grating, and light can be diffracted at the tunable grating. The processor turns off the tunable grating, that is, when the tunable grating is in the third state, the tunable grating is equivalent to a transparent plate, and light can continue to propagate through the tunable grating, that is, the light does not diffract at the tunable grating.

Among them, the active shutter lens is a lens that can be quickly switched on and off under the control of the processor. The processor turns on the active shutter lens, that is, when the active shutter lens is in the fourth state, the transmittance of the active shutter lens is relatively high, and light can normally propagate through the active shutter lens. The processor closes the active shutter lens, that is, when the active shutter lens is in the second state, the transmittance of the active shutter lens is close to 0, and the active shutter lens will block the light, that is, the light can hardly pass through the active shutter lens. The shutter lens absorbs light.

In one embodiment, the processor is configured to perform the first operation during the first period, and is further configured to perform the second operation during the second period. The first period and the second period form a period, and one period is less than or equal to 1/60 of a second.

It is important to understand that the flickering frequency perceivable by the human eye is 60Hz. Since a period is less than or equal to 1/60 of a second, that is, one second includes at least 60 periods, according to the phenomenon of persistence of vision (also known as visual pause phenomenon or afterglow effect), the human eye cannot perceive the virtual scene and the real scene outside. The switch is equivalent to that the human eye can see the existence of virtual scenes and the existence of real scenes in the outside world. That is, on the premise of ensuring the transmittance of the augmented reality device, the rainbow effect can be eliminated, and the display light leaked from the combiner can be blocked.

In one embodiment, the outer surface of the combiner includes a functional area, the ambient light emitted to the tunable grating is incident from the functional area of the outer surface of the combiner, and the diffracted light emitted to the outside of the combiner is incident from the outer surface of the combiner. The light emitting area exits, and the active shutter lens covers the light emitting area on the outer surface of the combiner. When the processor turns on the tunable grating and the image projector, and closes the active shutter lens, the ambient light directed to the tunable grating will not be directed to the inside of the combiner, preventing the ambient light from diffracting at the tunable grating and avoiding rainbow effects. produce. In addition, the diffracted light emitted to the outside of the combiner will not be emitted into the external environment, so as to avoid the leakage of the display light carrying the digital content.

In another embodiment, the active shutter lens covers the coupler, and the active shutter lens covers the outer surface of the coupler, so as to ensure the appearance integrity and consistency of the augmented reality device and improve the appearance of the augmented reality device. In addition, compared to the functional area where the active shutter lens only covers the outer surface of the coupler, the active shutter lens covers the outer surface of the coupler, which not only reduces the difficulty of the assembly process of the active shutter lens, but also does not require additional processing of the active shutter lens. , the processing difficulty of the active shutter lens is reduced, and the production cost of the active shutter lens is reduced.

In one embodiment, the active shutter lens is a liquid crystal light valve, the active shutter lens includes a liquid crystal cell, a first polarizer and a second polarizer, the liquid crystal cell is coupled to the processor, and the first polarizer is located at a side of the liquid crystal cell away from the combiner. On the side, the second polarizer is located between the liquid crystal cell and the combiner. That is, the second polarizer is located on the side of the liquid crystal cell away from the first polarizer, that is, the second polarizer is located on the side of the liquid crystal cell away from the combiner. The included angle between the direction of the light transmission axis of the second polarizer and the first polarizer is 90 degrees. When the processor turns on the active shutter lens, the ambient light is filtered by the first polarizer, and then goes through the liquid crystal cell and the second polarizer to the outer surface of the combiner in turn, and enters the human eye from the inner surface of the combiner, making the human eye The real world outside can be seen through the active shutter lens and combination.

Among them, the liquid crystal light valve is an optical device that realizes the phase retardation of light by controlling the refractive index of liquid crystal molecules by voltage.

In one embodiment, the active shutter lens is an in-plane switching (IPS) type liquid crystal light valve.

When the processor turns on the active shutter lens, that is, when the processor adjusts the active shutter lens to the fourth state, the liquid crystal light valve is in the power-on state at this time, and the ambient light enters the liquid crystal cell after being filtered by the first polarizer, and the liquid crystal cell will be filtered by the first polarizer. The phase retardation of the light emitted by the first polarizer is π. Since the transmission axis directions of the second polarizer and the first polarizer are perpendicular to each other, the light emitted by the liquid crystal cell can pass through the second polarizer and be directed towards the outer surface of the combiner. .

When the processor closes the active shutter lens, that is, when the processor adjusts the active shutter lens to the second state, the liquid crystal light valve is in a power-off state, and the ambient light enters the liquid crystal cell after being filtered by the first polarizer. The phase of the light emitted by the first polarizer, since the transmission axis directions of the second polarizer and the first polarizer are perpendicular to each other, the light emitted by the liquid crystal cell cannot pass through the second polarizer to the outer surface of the combiner. completely blocked by the second polarized light.

In one embodiment, the active shutter lens is a twisted nematic (TN) type liquid crystal light valve.

When the processor turns on the active shutter lens, that is, when the processor adjusts the active shutter lens to the fourth state, the liquid crystal light valve is in a power-off state, and the ambient light enters the liquid crystal cell after being filtered by the first polarizer. The light emitted by a polarizer has a phase retardation of π. Since the second polarizer is perpendicular to the transmission axis of the first polarizer, the light emitted by the liquid crystal cell can pass through the second polarizer and be directed towards the outer surface of the combiner.

When the processor closes the active shutter lens, that is, when the processor adjusts the active shutter lens to the second state, the liquid crystal light valve is in the power-on state, and the liquid crystal in the liquid crystal box will rotate into a state perpendicular to the first polarizer, and the ambient light After being filtered by the first polarizer, it enters the liquid crystal cell, and the liquid crystal cell does not change the phase of the light emitted by the first polarizer. It cannot pass through the second polarizer to the outer surface of the combiner and is thus completely blocked by the second polarizer.

In one embodiment, the liquid crystal light valve is a vertical alignment (VA) type liquid crystal light valve, a super twisted nematic (STN) type liquid crystal light valve or a ferroelectric liquid crystal (FLC) type. light valve.

In one embodiment, the augmented reality device further includes a quarter-wave plate, and the quarter-wave plate is installed on the surface of the first polarizer facing away from the liquid crystal light valve, that is, the quarter-wave plate is installed on the first polarizer. , and the included angle between the direction of the fast axis of the quarter-wave plate and the direction of the transmission axis of the first polarizer is 45 degrees.

It should be understood that many existing electronic screens are liquid crystal displays (LCDs), and the outgoing light of the liquid crystal displays is linearly polarized light. When the user wears the augmented reality device shown in this embodiment to observe the electronic screen, and the line of sight rotates around the electronic screen, no matter whether the polarization direction of the light emitted from the electronic screen is perpendicular or parallel to the light transmission axis direction of the first polarizer, a quarter of the One wave plate can attenuate linearly polarized light in any polarization direction to 50%. When the processor turns on the active shutter lens, the quarter wave plate can reduce the brightness difference that exists when the user is watching the electronic screen, which helps to improve the wearability of the user. The experience of using an augmented reality device when viewing an electronic screen.

In one embodiment, the augmented reality device includes two augmented reality components, the two augmented reality components are mounted on the frame at intervals, each augmented reality component includes the above-mentioned combiner, an image projector and an active shutter lens, and the two augmented reality components are The combiners are set side by side.

In the augmented reality device shown in this embodiment, one augmented reality component corresponds to the user's left eye, and the other augmented reality component corresponds to the user's right eye. The structures of the two augmented reality components are the same, that is, on the premise of ensuring the transmittance of the augmented reality device, the two augmented reality components prevent the display light carrying digital content from leaking out.

In one embodiment, the active shutter lens of each augmented reality component is a liquid crystal light valve, the active shutter lens of each augmented reality component includes a liquid crystal cell, a first polarizer and a second polarizer, and each augmented reality component includes a liquid crystal cell, a first polarizer, and a second polarizer. The liquid crystal cells are all coupled to the processor, the first polarizer of each augmented reality component is located on the side of the liquid crystal cell of the augmented reality component away from the combiner, and the second polarizer of each augmented display component is located on the side of the augmented reality component. between the liquid crystal cell and the combiner. That is, the second polarizer of each augmented reality component is located on the side of the liquid crystal cell of the augmented reality component away from the first polarizer, that is, the second polarizer of each augmented display component is located on the side of the liquid crystal cell of the augmented reality component facing One side of the first polarizer of the combiner. The included angle between the direction of the light transmission axis of the first polarizer and the second polarizer of each augmented reality component is 90 degrees.

When the processor turns on the active shutter lens, that is, when the processor adjusts the active shutter lens to the fourth state, after being filtered by the first polarizer, the ambient light passes through the liquid crystal cell and the second polarizer in turn and shoots towards the outer surface of the combiner. The inner surface of the combiner is projected into the human eye, so that the operator's left and right eyes can observe the real environment of the outside world.

In one embodiment, the augmented reality device includes two quarter wave plates, one quarter wave plate is mounted on the outer surface of a first polarizer, and the fast axis direction of the one quarter wave plate is the same as that of the first polarizer. The angle between the transmission axis directions of one first polarizer is 45 degrees, the other quarter-wave plate is mounted on the outer surface of the other first polarizer, and the other quarter-wave plate is fast. The included angle between the axis direction and the light transmission axis direction of the other first polarizer is 45 degrees, so as to reduce the brightness that exists when the left eye and the right eye view the electronic screen when the user wears the augmented reality device to watch the electronic screen The difference will help improve the user experience when wearing an augmented reality device to watch an electronic screen.

In one embodiment, the light transmission axis directions of the two first polarizers are the same, and the included angle between the fast axis directions of the two quarter wave plates is 90 degrees, or, the transmission axis of the two first polarizers The angle between the optical axis directions is 90 degrees, and the fast axis directions of the two quarter-wave plates are the same, so that when the user wears the augmented reality device to watch the electronic screen, the polarization directions of the two augmented reality components are perpendicular to each other. For example, the left-handed polarized light and the right-handed polarized light are respectively passed through. At this time, the two polarized lights whose polarization directions are perpendicular to each other enter the user's left eye and right eye respectively for imaging. When the processor turns on the active shutter lens, that is, when the processor adjusts the active shutter lens to the fourth state, the user can view a three-dimensions (3D) image. That is, the augmented reality device shown in this embodiment can also be used in a 3D movie theater, and can be compatible with both polarization-type and active-shutter-type projection methods.

In one embodiment, the augmented reality device further includes a zoomer, and the zoomer is installed on the inner side of the combiner. That is, the zoom device is located on the side of the combiner close to the human eye to correct the user's vision. When the user suffers from vision problems such as nearsightedness, farsightedness or astigmatism, the zoom device can correct the user's refractive error when the user is watching the virtual scene or the real scene outside, and improve the clarity of the user when viewing the virtual scene or the real scene in the outside world. Improve the user experience of using augmented reality devices.

In one embodiment, the processor is coupled to the zoomer, and the processor is used to adjust the optical power of the zoomer. When the user needs to use the augmented reality device, the processor can adjust the focal power of the zoom device to match the user's eyesight according to the user's diopter, so as to improve the adaptation of the augmented reality device, thereby improving the flexibility of the use of the augmented reality device. sex.

In one embodiment, the augmented reality device further includes an eye tracking component, the eye tracking component is mounted on the frame to track the line of sight of the eyeball, and the processor couples the zoomer and the eye tracking component;

The processor is used to turn off the image projector and adjust the focal power of the zoom to the first focal power, so as to correct the user's refractive error when the user watches the real scene outside, and improve the clarity when the user observes the real scene outside Spend;

The processor is used to turn on the image projector, the eye tracking component is used to obtain the vergence depth of the virtual scene watched by the eye, and the processor adjusts the optical power of the zoom to the second optical power according to the acquisition result of the eye tracking component.

Specifically, the eye tracking component is used to track the line of sight of the eye, and obtain the vergence depth of the virtual scene the user is watching according to the line of sight of the eye, and the processor changes the virtual image distance of the virtual scene according to the vergence depth, and adjusts the position of the virtual scene to the In terms of vergence depth, it can not only correct the user's refractive error when the user observes the virtual scene, improve the clarity of the user's observation of the virtual scene, but also solve the conflict of visual vergence adjustment, reduce the user's discomfort when using the augmented reality device, and improve the User comfort.

The first refractive power is the diopter of the user's eyeball, and the second refractive power is the sum of the inverse of the first refractive power and the virtual image depth observed by the user.

In one embodiment, the eye tracking component includes one or more infrared light-emitting diodes and one or more infrared cameras, the infrared light emitted by the infrared light-emitting diodes enters the user's human eye, and is reflected by the human eye's cornea into the infrared camera for imaging, The processor obtains the optical axis direction of the user's eyeball through the position of the infrared light spot in the image, obtains the user's line of sight direction after calibrating the optical axis direction of the eyeball, and determines the depth of the virtual scene viewed by the user according to the user's line of sight direction, and then Adjust the power of the zoom to the second power.

In a second aspect, the present application provides a display method for an augmented reality device. The enhanced display device includes a frame, a combiner, an active shutter lens and an image projector, the combiner is mounted on the frame, the combiner includes a tunable grating, the active shutter lens is mounted on the outside of the combiner and covers the tunable grating, and the image is projected The machine is mounted on the frame. The display method of the enhanced display device includes alternately performing the first operation and the second operation.

At this time, the image projector projects display light to the combiner, and the display light is diffracted at the tunable grating to form diffracted light, part of the diffracted light goes to the inside of the combiner, and part of the diffracted light goes to the outside of the combiner. The active shutter lens shields the diffracted light from the outside of the combiner, prevents the diffracted light from the outside of the combiner from passing through the active shutter lens to the outside environment, and prevents the diffracted light carrying digital content from leaking out, which not only improves the user experience The privacy of the augmented reality device and the social nature of the augmented reality device can also be avoided, and the leaked diffracted light can be prevented from forming a small display window on the surface of the augmented reality device, which improves the appearance of the user when using the augmented reality device.

At this time, the image projector does not project display light to the combiner. After the ambient light passes through the active shutter lens and the tunable grating, it is emitted to the inside of the combiner, so that the user can see the real scene outside through the combiner and the active shutter glass, so as to ensure that the augmented reality device has a certain transmittance.

In one embodiment, the first operation is performed in the first time period, and the second operation is performed in the second time period, the first time period and the second time period form a cycle, and one cycle is less than or equal to 1/60 second.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background technology, the accompanying drawings required in the embodiments or the background technology of the present application will be described below.

FIG. 1 is a schematic structural diagram of an augmented reality device provided by an embodiment of the present application;

FIG. 2 is a schematic structural diagram of the augmented reality device shown in FIG. 1 being worn on the head of a user;

Fig. 3 is the simplified structural schematic diagram of the structure shown in Fig. 2;

FIG. 4 is an enlarged schematic view of the structure of the area A in the structure shown in FIG. 3 under an embodiment;

Fig. 5a is a schematic plan view of the structure of the combiner 31 in another embodiment in the structure shown in Fig. 4;

Fig. 5b is a schematic plan view of the structure of the combiner 31 in the third embodiment in the structure shown in Fig. 4;

Fig. 5c is a schematic plan view of the structure of the combiner 31 in the fourth embodiment in the structure shown in Fig. 4;

Figure 6a is a schematic structural diagram of the tunable grating in the structure shown in Figure 4 when it is in a first state;

Figure 6b is a schematic structural diagram of the tunable grating in the structure shown in Figure 4 when it is in a third state;

7 is a schematic diagram of the optical path of the structure shown in FIG. 4 in one state;

8 is a schematic diagram of the optical path of the structure shown in FIG. 4 in another state;

Fig. 9 is the enlarged structural schematic diagram of A region under another embodiment in the structure shown in Fig. 3;

Figure 10a is a schematic structural diagram of the active shutter lens in the fourth state in the structure shown in Figure 9;

Fig. 10b is a schematic structural diagram of the active shutter lens in the second state in the structure shown in Fig. 9;

FIG. 11 is a schematic diagram of the working state of the tunable grating, the image projector and the active shutter lens when the augmented reality device shown in FIG. 9 is in operation;

12 is an enlarged schematic view of the structure of the A region under the third embodiment in the structure shown in FIG. 3;

FIG. 13 is a schematic structural diagram of an active shutter lens and a quarter-wave plate in the structure shown in FIG. 12;

14 is an enlarged schematic view of the structure of the A region under the fourth embodiment in the structure shown in FIG. 3;

15 is an enlarged schematic view of the structure of the A region under the fifth embodiment in the structure shown in FIG. 3;

FIG. 16 is a schematic diagram of the working state of the tunable grating, the image projector, the active shutter lens and the zoomer when the augmented reality device shown in FIG. 15 is in operation.

Detailed ways

The embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.

Please refer to FIG. 1 . FIG. 1 is a schematic structural diagram of an augmented reality device 100 provided by an embodiment of the present application.

The augmented reality device 100 may be an electronic product, such as AR glasses, AR helmet, mixed reality (MR) glasses or an MR helmet, that combines digital content with a real scene. The augmented reality device 100 of the embodiment shown in FIG. 1 is described by taking AR glasses as an example.

In this embodiment, the augmented reality device 100 includes a frame 10 and an augmented reality component 30 mounted on the frame 10 . Among them, there are two augmented reality components 30 , and the two augmented reality components 30 are installed on the glasses frame 10 at intervals.

The spectacle frame 10 includes a spectacle frame 11 and a temple 12 connected with the spectacle frame 11 . There are two temples 12 , and the two temples 12 are connected to opposite ends of the frame 11 . It should be noted that, in other embodiments, the spectacle frame 10 may also include a spectacle frame 11 and a fixing band connected to the spectacle frame 11 , which is not specifically limited in this application.

The mirror frame 11 includes two frames 13 and a beam 14 connected between the two frames 13 . Each frame 13 includes a first frame 131 away from the beam 14 and a second frame 132 opposite to the first frame 131 . A receiving cavity (not shown) is provided inside the first frame 131 , and the receiving cavity of the first frame 131 is used to house the electronic components of the augmented reality device 100 . The beam 14 is integrally formed with the two frames 13 to simplify the forming process of the mirror frame 11 and increase the overall strength of the mirror frame 11 . Wherein, the material of the frame 11 includes but is not limited to metal, plastic, resin or natural materials. It should be understood that the spectacle frame 11 is not limited to the full rim type spectacle frame shown in FIG. 1 , but may also be a half rim type or a rimless type spectacle frame.

The two temples 12 are rotatably connected to opposite ends of the frame 11 . Specifically, the two temples 12 are respectively rotatably connected to the two frames 13 of the mirror frame 11 . The two temples 12 are respectively connected to the first frame 131 of the two frames 13 . When the augmented reality device 100 is in the unfolded state (as shown in FIG. 1 ), the two temples 12 are rotated relative to the mirror frame 11 to be opposite to each other. At this time, the two temples 12 of the augmented reality device 100 can be respectively erected on the two temples of the user. On each ear, the beam 14 is erected on the bridge of the user's nose so as to be worn on the user's head. When the augmented reality device 100 is in the folded state, the two temples 12 are rotated relative to the mirror frame 11 to at least partially overlap each other and are accommodated inside the mirror frame 11, and the augmented reality device 100 can be stored at this time. It can be understood that, in other embodiments, the two temples 12 may be fixedly connected to the first frame 131 of the two frames 13 respectively, or the two temples 12 may be integrally formed with the frame 11 , that is, the augmented reality device 100 It is always in an expanded state, which is not specifically limited in this application. It should be noted that, the inside of the temple 12 may also be provided with a receiving cavity, and the receiving cavity of the temple 12 may also accommodate the electronic components of the augmented reality device 100 .

It should be noted that when referring to the augmented reality device 100 in this application, the terms "inside" and "outside" are mainly used to describe the orientation when the augmented reality device 100 is worn on the user's head. When the augmented reality device 100 is worn by the user, the inside is close to the user's head, and the outside is far from the user's head, which does not limit the orientation of the augmented reality device 100 in other scenes.

Please refer to Figure 2 and Figure 3 together. FIG. 2 is a schematic structural diagram of the augmented reality device 100 shown in FIG. 1 worn on the user's head. FIG. 3 is a simplified structural schematic diagram of the structure shown in FIG. 2 .

Next, for ease of description, as shown in FIGS. 2 and 3 , the length direction of the augmented reality device 100 is defined as the X-axis direction, the width direction of the augmented reality device 100 is defined as the Y-axis direction, and the thickness direction of the augmented reality device 100 is defined as the Z-axis direction axis direction, and the X, Y, and Z directions are perpendicular to each other. The X-axis direction is the direction in which one frame 13 of the mirror frame 11 faces the other frame 13 , and the Z-axis direction is the direction in which the temple legs 12 face the mirror frame 11 .

In this embodiment, the structures of the two augmented reality components 30 are the same. Specifically, the two augmented reality components 30 are respectively installed on the two frames 13 of the mirror frame 11 . When the augmented reality device 100 is worn on the user's head, one augmented reality component 30 corresponds to the user's left eye, and the other augmented reality component 30 corresponds to the user's right eye, and the user's eyes can be viewed through the two augmented reality components 30 Virtual and real scenes. It should be noted that, in other embodiments, the structures of the two augmented reality components 30 may also be different, which is not specifically limited in this application.

Next, for ease of understanding, the structure of the augmented reality component 30 is described in detail by taking the augmented reality component 30 corresponding to the user's right eye as an example.

Please refer to FIG. 3 and FIG. 4 . FIG. 4 is an enlarged schematic structural diagram of the area A in the structure shown in FIG. 3 under an embodiment.

The augmented reality component 30 includes a combiner 31 , an image projector 32 , an active shutter glass 33 and a processor 34 . Specifically, the coupler 31 is installed on the frame 10 . The combiner 31 includes a tunable grating 316 . The active shutter lens 33 is mounted on the outside of the combiner 31 and covers the tunable grating 316 . The image projector 32 is attached to the mirror frame 10 . The processor 34 is coupled to the tunable grating 316 , the image projector 32 and the active shutter glass 33 for controlling the opening and closing of the image projector 32 , and for adjusting the working states of the tunable grating 316 and the active shutter glass 33 .

It should be noted that, in other embodiments, the two augmented reality components 30 may include only one processor 34, and the processor 34 is simultaneously coupled to the image projectors 32 of the two augmented reality components 30 to control the two image projections The opening and closing of the machine 32 is not specifically limited in this application.

The coupler 31 is attached to the frame 11 of the frame 10 . In this embodiment, the couplers 31 of the two enhanced display assemblies 30 are arranged side by side along the X-axis direction. Specifically, the couplers 31 of the two augmented reality components 30 are installed on the mirror frame 11 at intervals. Wherein, the coupler 31 is installed on the frame 13 of the mirror frame 11 . The inner surface 312 of the coupler 31 is the surface of the coupler 31 facing the inner side of the lens frame 11 . The outer surface 313 of the coupler 31 is the surface of the coupler 31 facing the outside of the lens frame 11 . In this embodiment, the combiner 31 is a diffractive optical waveguide that uses a diffractive optical waveguide technology to combine the digital content and the real scene.

Specifically, the combiner 31 further includes a substrate 314 and a coupling grating 315 . The base 314 is mounted on the frame 13 . One end of the base 314 is mounted on the first frame 131 of the frame 13 and received in the receiving cavity 133 of the first frame 131 . The other end of the base 314 is mounted on the second frame 133 of the frame 13 . The substrate 314 includes an inner surface (not shown) and an outer surface (not shown) disposed opposite to each other. The inner surface of the base 314 is the surface of the base 314 facing the inner side of the mirror frame 11 . The outer surface of the base 314 is the surface of the base 314 facing the outside of the lens frame 11 .

In one embodiment, the tunable grating 316 may include an out-coupling grating. In-coupling grating 315 and tunable grating 316 are both reflective gratings. Specifically, the coupling grating 315 is mounted on the outer surface of the base 314 and is located in the receiving cavity 133 of the first frame 131 . Tunable grating 316 is coupled to processor 34 . The tunable grating 316 is mounted on the outer surface of the substrate 314 , is spaced apart from the coupling grating 315 , and is located between the first frame 131 and the second frame 133 .

In some other embodiments, the coupling-in grating 315 and the tunable grating 316 can also be transmission gratings, in which case the coupling-in grating 315 and the tunable grating 316 are mounted on the inner surface of the substrate 314 . In addition, the coupling grating 315 and the tunable grating 316 can also be holographic gratings, tilt gratings, polarization gratings, liquid crystal gratings, holographic optical elements or diffractive optical elements, which are not specifically limited in this application.

It should be understood that a grating refers to an optical device composed of a large number of parallel slits of equal width and spacing. When light is incident on the grating surface at a certain angle, the grating can adjust the amplitude or phase of the light periodically in space, so the light will exit the grating surface from a direction different from the angle of incidence. The description of the grating will be understood in the same way hereinafter.

Please refer to FIG. 5a. FIG. 5a is a schematic plan view of the combiner 31 shown in FIG. 4 under another embodiment.

In this embodiment, the tunable grating 316 may include an out-coupling grating 3161 and a pupil-expanding grating 3162 . The coupling-in grating 315 , the out-coupling grating 3161 and the pupil-expansion grating 3162 are all reflective gratings and are mounted on the outer surface of the substrate 314 . Specifically, the pupil dilation grating 3162 is located on the lower side of the coupling-in grating 315 and is opposite to the coupling-out grating 3161 . The pupil-expanding grating 3162 is used to expand the light coupled into the substrate 314 via the in-coupling grating 315 and then transmit it to the out-coupling grating 3161 to improve the uniformity of the light. In other embodiments, the tunable grating 316 may also include all other gratings in the diffractive optical waveguide except the coupling-in grating 315 .

It should be noted that the azimuth words such as “lower side” when referring to the pupil grating 3162 in this application are mainly described based on the azimuth of the coupling grating 315 , and do not constitute the azimuth of the augmented reality device 100 in other scenes. The same understanding can be made for the description of the orientation of the pupil dilation grating 3162 in the following.

Please refer to FIG. 5b. FIG. 5b is a schematic plan view of the combiner 31 shown in FIG. 4 under the third embodiment.

In this embodiment, the tunable grating 316 may include an out-coupling grating 3161 and a pupil-expanding grating 3162 . The coupling-in grating 315 , the out-coupling grating 3161 and the pupil-expansion grating 3162 are all reflective gratings and are mounted on the outer surface of the substrate 314 . Specifically, the pupil dilation grating 3162 is located on the right side of the coupling-in grating 315 and is opposite to the coupling-out grating 316 .

Please refer to FIG. 5c, which is a schematic plan view of the structure of the combiner 31 shown in FIG. 4 under the fourth embodiment.

In this embodiment, the tunable grating 316 may include an out-coupling grating 3161 and a pupil-expanding grating 3162 . The coupling-in grating 315 , the out-coupling grating 3161 and the pupil-expansion grating 3162 are all reflective gratings and are mounted on the outer surface of the substrate 314 . Among them, there are two pupil dilation gratings 3162. Specifically, one pupil dilation grating 3162 is located on the right side of the coupling-in grating 315 , the other pupil dilation grating 3162 is located on the left side of the coupling-in grating 315 , and the two pupil dilation gratings 3162 are opposite to the out-coupling grating 3161 .

Please refer to FIGS. 6a and 6b. FIG. 6a is a schematic view of the structure of the structure shown in FIG. 4 when the tunable grating 316 is in the first state, and FIG. 6b is the structure of the structure shown in FIG. 4 when the tunable grating 316 is in the third state. Schematic.

In this embodiment, the tunable grating 316 may be a grating made of liquid crystal and photopolymer. Wherein, the photopolymers include, but are not limited to, acrylamide-based and polyethanol-based photopolymers, acrylate-based photopolymers, thiol-hydrocarbon-based photopolymers, or nanoparticle-doped photopolymers. Specifically, the tunable grating 316 has two working states, the two working states are a first state and a third state respectively, and the processor 34 is used to adjust the working state of the tunable grating 316 .

When the processor 34 (as shown in FIG. 4 ) powers on the tunable grating 316, the tunable grating 316 is in the first state, and the tunable grating 316 is a diffraction grating, which can diffract light. At this time, the refractive indices of the liquid crystal and the polymer in the tunable grating 316 are different, and the liquid crystal and the polymer are arranged periodically, so that the tunable grating 316 behaves as a diffraction grating. The tunable grating 316 includes a plurality of liquid crystal groups, and each liquid crystal group is formed by analyzing a plurality of liquid crystals. Each liquid crystal group is uniformly arranged at an angle, and the distance between two adjacent liquid crystal groups is a period. It should be noted that the present application does not specifically limit the angle of the liquid crystal groups, that is, the liquid crystal groups can be uniformly arranged at any angle.

When the processor 34 powers off the tunable grating 316, the tunable grating 316 is in the third state, and the tunable grating 316 is a transparent flat plate that does not diffract light. At this time, the refractive indices of the liquid crystal and the polymer in the tunable grating 316 are the same, and the tunable grating 316 is a parallel flat plate that is uniform as a whole. Therein, the outer and inner surfaces of the tunable grating 316 are parallel (with a little deviation allowed).

In some other embodiments, when the processor 34 powers on the tunable grating 316, the tunable grating 316 is in an off state, and the tunable grating 316 is a transparent plate that does not diffract light, and the processor 34 provides the tunable When the grating 316 is powered off, the tunable grating 316 is in an on state, and the tunable grating 316 is a diffraction grating that can diffract light.

Referring to FIG. 4 , the coupler 31 includes an inner surface 312 and an outer surface 313 disposed opposite to each other. In this embodiment, the inner surface 312 of the coupler 31 is the inner surface of the base 314 . The inner surface 312 of the combiner 31 includes a light incident area 3121 and a light exit area 3122 . The light incident area 3121 of the inner surface 312 is located in the receiving cavity 133 of the first frame 131 . Specifically, the light incident area 3121 of the inner surface 312 is the area covered by the projection of the coupling-in grating 315 on the inner surface 312 . That is, the area of the inner surface 312 of the combiner 31 that is directly opposite to the coupling-in grating 315 is the light incident area 3121 of the inner surface 312 .

The light outgoing area 3122 and the light incoming area 3121 of the inner surface 312 are spaced apart and located between the first frame 131 and the second frame 132 . Specifically, the light emitting area 3122 of the inner surface 312 is the area covered by the projection of the tunable grating 316 on the inner surface 312 . That is, the area of the inner surface 312 that is directly opposite to the tunable grating 316 is the light emitting area 3122 of the inner surface 3123 .

The outer surface 313 of the combiner 31 includes the surface of the in-coupling grating 315 facing away from the substrate 314 , the surface of the tunable grating 316 facing away from the substrate 314 , and the area of the outer surface of the substrate 314 not covered by the in-coupling grating 315 and the tunable grating 316 . That is, the outer surface 313 of the combiner 31 includes the outer surface of the in-coupling grating 315 , the outer surface of the tunable grating 316 , and the regions of the outer surface of the substrate 314 that are not covered by the in-coupling grating 315 and the tunable grating 316 . Wherein, the outer surface 313 of the coupler 31 includes a functional area 3131 . Specifically, the functional area 3131 of the outer surface 313 is the surface of the tunable grating 316 facing away from the substrate 314 , that is, the outer surface of the tunable grating 316 .

In this embodiment, the image projector 32 is located in the accommodating cavity 133 of the first frame 131 and is disposed opposite to the combiner 31 . Specifically, the image projector 32 is located on the side of the substrate 314 away from the coupling-in grating 315 . That is, the image projector 32 and the coupling grating 315 are located on opposite sides of the substrate 314, respectively. The image projector 32 faces the light incident area 3121 of the inner surface 312 . It can be understood that when the coupling grating 315 is a transmission grating, the image projector 32 and the coupling grating 315 are located on the same side of the substrate 314 . It should be noted that in other embodiments, the image projector 32 may also be located in the receiving cavity of the temple 12 (that is, inside the temple 12 ), or the image projector 32 may also be partially located in the receiving cavity of the first frame 131 133, part of which is located in the receiving cavity of the temple 12, or, the image projector 32 may not be located in the receiving cavity 133 of the first frame 131 or the receiving cavity of the temple 12, and is directly exposed on the surface of the frame 13, as long as the augmented reality When the device 100 is in use, it is sufficient that the user's sight is not blocked.

The image projector 32 includes but is not limited to liquid crystal on silicon (LCOS), digital light processing (DLP), light emitting diode (LED), organic light emitting diode (organic light -emitting diode, OLED), quantum dot light emitting diode (quantum dot light emitting diode, QLED), active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light emitting diode (flex light-emitting diode, FLED), Mini LED, Micro OLED, Micro LED or laser micro electro mechanical systems (laser micro electro mechanical systems, Laser MEMS) and other optomechanical systems.

Please refer to FIG. 7 , which is a schematic diagram of the optical path of the structure shown in FIG. 4 in one state.

When the processor 34 turns on the image projector 32 and adjusts the tunable grating 316 to the first state, the tunable grating 316 is in the first state, and the image projector 32 is in the on state, the image projector 32 turns to the combiner. 31 projects the display light L0, the display light L0 is diffracted at the tunable grating 316 to form diffracted light, part of the diffracted light goes to the inside of the combiner 31, and part of the diffracted light (L2 in the figure) goes to the outside of the combiner 31. The image projector 32 projects the display light L0 carrying the digital content. It can be understood that the diffracted light ray L1 and the illustration L2 are also light rays that carry digital content.

Specifically, the display light L0 is directed toward the inner surface of the substrate 314 (ie, the inner surface 312 of the combiner 31 ) (in FIG. 7 , the vertical incidence is taken as an example), and the light incident area 3121 of the inner surface 312 is perpendicular to the coupling grating 315 , The substrate 314 is coupled via the coupling grating 315 . The coupling-in grating 315 has adjusted the propagation direction of the display light L0 to a state that satisfies the condition of total reflection. The display light L0 undergoes at least one total reflection in the substrate 314 and propagates toward the direction of the tunable grating 316 until reaching the tunable grating 316 . Since the tunable grating 316 is in an on state, the display light L0 will be diffracted under the action of the tunable grating 316 to form diffracted light. Part of the diffracted light rays are emitted from the light emitting area 3122 of the inner surface 312 to the inner side of the combiner 31, that is, to propagate in the direction of the human eye. In the figure, this part of the light rays are marked as the eye ray L1, and the incident ray L1 can enter the human eye for imaging, so that the The user can see a virtual scene carrying digital content. At the same time, part of the diffracted light rays are emitted from the functional area 3131 of the outer surface 313 to the outside of the combiner 31 , and the part of the light rays are marked as leaked light rays L2 in FIG. 7 .

When the processor 34 turns the image projector 32 off and on, and adjusts the tunable grating 316 to the third state, the tunable grating 316 is in the third state and the image projector 32 is in the on state, the image projector 32 reports to the combiner 31 . The display light L0 is projected, and the display light L0 exits from the outer surface 313 of the combiner 31 . Specifically, the display light L0 is perpendicular to the inner surface of the substrate 314 (ie, the inner surface 312 of the combiner 31 ), from the light incident area 3121 of the inner surface 312 to the coupling grating 315 vertically, and is coupled into the substrate through the coupling grating 315 314. The display light L0 undergoes at least one total reflection in the substrate 314 and propagates toward the direction of the tunable grating 316 until reaching the tunable grating 316 .

When the processor 34 turns off the image projector 32 (the processor 34 can turn on or off the tunable grating 316), that is, when the image projector 32 is in the off state (the tunable grating 316 can be in the first state or in the third state at this time) state), the image projector 32 does not project the display light L0, at this time neither the entering light L1 enters the human eye for imaging, nor does the leaking light L2 propagate to the outside of the combiner 31.

Referring to FIG. 4 , the active shutter glass 33 is located on the side of the combiner 31 away from the image projector 32 , that is, the active shutter glass 33 and the image projector 32 are located on opposite sides of the combiner 31 . In this embodiment, the active shutter lens 33 is a lens based on electrochromic materials (except liquid crystal). It should be understood that the active shutter lens 33 is a lens that can be quickly switched on and off under the control of the processor 34 . Specifically, the active shutter lens 33 has two working states, the two working states are the second state and the fourth state respectively, and the processor 34 is used to adjust the working state of the active shutter lens 33 .

When the processor 34 turns on the active shutter lens 33 , that is, when the active shutter lens 33 is in the fourth state, the transmittance of the active shutter lens 33 is relatively high (the transmittance is greater than 40%), and the light can pass through the active shutter lens 33 to transmit normally . When the processor 34 closes the active shutter lens 33, that is, when the active shutter lens 33 is in the second state, the transmittance of the active shutter lens 33 is low (the transmittance is close to 0), and the active shutter lens 33 will block the light, that is, the light It cannot propagate through the active shutter lens 33, that is, the active shutter lens 33 can absorb light.

In this embodiment, the two ends of the active shutter lens 33 can be respectively mounted on the outer surface 313 of the coupler 31 through a sealant. An air gap exists between the middle part of the active shutter lens 33 and the outer surface 313 of the combiner 31 to ensure that the display light L0 can be totally reflected in the diffractive optical waveguide. Among them, the width d of the air gap is about 50 μm. It should be understood that since the thicknesses of the in-coupling grating 315 and the tunable grating 316 are on the nanometer scale, the active shutter lens 33 does not come into contact with the in-coupling grating 315 and the tunable grating 316 .

The active shutter glass 33 covers the coupler 31 . Specifically, the active shutter lens 33 covers the outer surface 313 of the coupler 31 to ensure the appearance integrity and consistency of the augmented reality device 100 and improve the appearance of the augmented reality device 100 . That is, active shutter lens 33 covers the outer surface of in-coupling grating 315, the outer surface of tunable grating 316, and the portion of the outer surface of substrate 314 that is not covered by in-coupling grating 315 and tunable grating 316. At this time, the active shutter glass 33 can act as a protective glass to protect the in-coupling grating 315 and the tunable grating 316 .

It should be noted that, in other embodiments, the active shutter lens 33 may only cover the functional area 3131 of the outer surface 313 , that is, the active shutter lens 33 may only cover the outer surface of the tunable grating 316 . It can be understood that, compared with the active shutter lens 33 that only covers the functional area 3131 of the outer surface 313, the active shutter lens 33 covers the outer surface 313 of the coupler 31, which not only reduces the assembly process difficulty of the active shutter lens 33, but also does not require The additional processing of the active shutter lens 33 reduces the processing difficulty of the active shutter lens 33 and reduces the production cost of the active shutter lens 33 .

In this embodiment, the processor 34 is located in the receiving cavity 133 of the first frame 131 and is electrically connected to the tunable grating 316 , the image projector 32 and the active shutter lens 33 . The processor 34 may include one or more processing units. The multiple processing units can be, for example, an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video Codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. It should be understood that the processor 34 may be a central processing unit (central processing unit, CPU) of the augmented reality device 100 , or may be other processors of the augmented reality device 100 .

The processor 34 is configured to alternately perform the first operation and the second operation. Specifically, the processor 34 controls the image projector 32 to be turned on and off synchronously, and adjusts the working states of the tunable grating 316 and the active shutter glass 33 . That is, the processor 34 can control the opening and closing of the image projector 32 and control the working state of the active shutter glass 33 at the same time when adjusting the working state of the tunable grating 316 . That is, the processor 34 switches the working states of the tunable grating 316 , the image projector 32 and the active shutter glass 33 synchronously.

Referring to FIG. 7 , when the processor 34 performs the first operation, the processor 34 turns on the image projector 32 , adjusts the tunable grating 316 to the first state, and adjusts the active shutter glass 33 to the second state. When the tuning grating 316 is in the first state, the image projector 32 is in the on state, and the active shutter glass 33 is in the second state, the active shutter glass 33 blocks the display light L0 emitted from the outer surface 313 of the combiner 31 and the light emitted to the combiner ambient light LC at the outer surface 313 of the device 31 .

Specifically, after the display light L0 projected by the image projector 32 enters the combiner 31 from the light incident area 3121 of the inner surface 312, the incident light L1 enters the human eye from the light exit area 3121 of the inner surface 312 for imaging, and the leaked light L2 comes from the outer surface. The functional area 3131 of 313 is directed towards the active shutter glass 33 . Since the active shutter lens 33 is in the closed state at this time, the transmittance of the active shutter lens 33 is close to 0, and the active shutter lens 33 blocks the leaked light L2, which is equivalent to the active shutter lens 33 absorbing the leaked light L2, preventing the self-combiner 31 from penetrating The leaked light L2 emitted from the outer surface 313 passes through the active shutter lens 33 and is injected into the external environment, so as to prevent the leaked light L2 carrying digital content from leaking out, which can not only improve the privacy of the user and the sociality of the augmented reality device 100, but also improve the user's privacy. It is possible to prevent the leaked light L2 from forming a small display window on the surface of the augmented reality device 100 , thereby improving the appearance of the user when using the augmented reality device 100 .

At this time, the ambient light Lc is directed toward the active shutter lens 33 from the outside. Since the active shutter lens 33 is in the closed state, the light transmittance of the active shutter lens 33 is close to 0, and the active shutter lens 33 completely blocks the ambient light Lc, which is equivalent to the active shutter lens 33 absorbing the ambient light Lc and preventing the ambient light Lc from entering the ambient light Lc. Diffraction is generated by tuning the grating 316 , which prevents the human eye from seeing light with multiple colors, which can effectively avoid the occurrence of rainbow effects, and improves the user experience when using the enhanced display device 100 .

Please refer to FIG. 8 , which is a schematic diagram of the optical path of the structure shown in FIG. 4 in another state.

When the processor 34 performs the second operation, the processor 34 turns off the image projector 32, adjusts the tunable grating 316 to the first state, and adjusts the active shutter glass 33 to the second state, that is, the image projector 32 is turned off state, when the tunable grating 316 is in the first state and the active shutter glass 33 is in the second state, the ambient light Lc can pass through the active shutter glass 33 from the outer surface 313 of the combiner 31 into the combiner 31 , and pass through the combiner 31 The inner surface 312 exits. Since the active shutter glass 33 is in the open state at this time, the transmittance of the active shutter glass 33 is relatively high, and the ambient light Lc can pass through the active shutter glass 33 and enter the combiner 31 from the outer surface of the tunable grating 316 . Since the tunable grating 316 is in a closed state, the ambient light Lc can directly pass through the tunable grating 316 and propagate from the inner surface 312 of the combiner 31 toward the human eye, thereby entering the human eye for imaging. That is, the human eye can view the real scene of the outside world through the active shutter lens 33 and the combiner 31 . In addition, since the image projector 32 is turned off, the image projector 32 does not project the display light L0 carrying the digital content, neither the incident light L1 enters the human eye nor the leakage light L2 leaks out of the augmented reality device 100 . That is, the human eye can only see the real scene outside.

In one embodiment, the processor 34 includes a control unit and a storage unit. The control unit is used to control the opening and closing of the image projector 32 and the active shutter glass 33 . The storage unit is used for storing the preset frequency f0, and the preset frequency f0 is equal to or greater than 60 Hz. Specifically, when the augmented reality device 100 is turned on, the image projector 32 and the active shutter glass 33 are in different states during the first period and the second period, respectively. During the first period, the processor 34 performs the first operation, at this time, the tunable grating 316 and the image projector 32 are in an on state, and the active shutter glass 33 is in a closed state. During the second period, the processor 34 performs the second operation, at which time the tunable grating 316 and the image projector 32 are in an off state, and the active shutter glass 33 is in an on state.

Wherein, the first period and the second period form a period T, 1/T=f0. That is, T is less than or equal to 1/60 second. That is to say, when the augmented reality device 100 is turned on, 1 second includes at least 60 cycles, that is, the first period and the second period appear at least 60 times in 1 second. That is, the frequency at which the image projector 32 alternates between on and off states is greater than 120 Hz. The frequency of alternating between the closed and open states of the active shutter glass 33 is greater than 120 Hz.

It should be understood that the flicker frequency (also known as the refresh rate of the human eye) perceivable by the human eye is 60Hz. Since the preset switching frequency is greater than the refresh rate of the human eye, according to the persistence of vision phenomenon (also known as the visual pause phenomenon or the afterglow effect), when the augmented reality device 100 is working, the display light L0 projected by the existing image projector 32 enters the human eye, And the ambient light Lc enters the human eye, that is, the human eye can see both the virtual scene and the real scene outside. Also, not only can the rainbow effect be eliminated, but also the display light projected from the image projector 32 does not leak out of the augmented reality device 100 . That is to say, the augmented reality device 100 shown in this embodiment can not only greatly alleviate the rainbow effect, but also improve the user's experience of using the augmented display device 100 on the premise of ensuring the transmittance of the augmented reality device 100 , and also block the The display light leaked from the combiner 31 is improved, the privacy and sociality of the augmented reality device 100 are improved, and the appearance of the user when using the augmented reality device 100 is improved.

Please refer to FIG. 9 . FIG. 9 is an enlarged schematic structural diagram of the area A in the structure shown in FIG. 3 under another embodiment.

The enhanced display components of the enhanced display device include a combiner 31 , an image projector 32 , an active shutter glass 33 and a processor 34 . The coupler 31 is attached to the frame 10 . The active shutter glass 33 is mounted on the outer surface of the combiner 31 , the image projector 32 is mounted on the frame 10 , and the processor 34 couples the combiner 31 , the image projector 32 and the active shutter glass 33 .

The difference between the augmented reality device shown in this embodiment and the augmented reality device 100 shown in the above embodiments is that the active shutter lens 33 is a liquid crystal light valve. The active shutter lens 33 includes a liquid crystal cell 331 , a first polarizer 332 and a second polarizer 333 . The liquid crystal cell 331 is coupled to the processor 34 . The first polarizer 332 is located on the side of the liquid crystal cell 331 facing away from the combiner 31 , and the first polarizer 332 covers the surface of the liquid crystal cell 331 facing away from the combiner 31 . That is, the first polarizer 332 covers the outer surfaces of the liquid crystal and 331 . The second polarizer 333 is located between the liquid crystal cell 331 and the combiner 31 . That is, the second polarizer 333 is located on the side of the liquid crystal cell 331 away from the first polarizer 332 , that is, the second polarizer 333 is located on the side of the liquid crystal cell 331 facing the combiner 31 . In addition, the second polarizer 333 covers the inner surface of the liquid crystal cell 331 . That is, the second polarizer 333 covers the surface of the liquid crystal cell 331 facing the combiner 31 . The first polarizer 332 is perpendicular to the light transmission axis of the second polarizer 333 . That is, the polarization direction of the light emitted through the first polarizer 332 and the polarization direction of the light emitted through the second polarized light 333 are perpendicular to each other.

It should be noted that the liquid crystal light valve is an optical device that realizes the phase retardation of light by controlling the refractive index of liquid crystal molecules by voltage. According to the working principle of liquid crystal molecules, the liquid crystal cell 331 is used to retard the phase of light. The first polarizer 332 is used to change the polarization state of the incident light incident on the outer surface of the liquid crystal cell 331, and convert the incident light into linearly polarized light, so that the incident light can pass through the liquid crystal cell 331 and the second polarizer 333 to be combined. the outer surface 313 of the device 31 .

Please refer to FIGS. 10a and 10b together. FIG. 10a is a schematic diagram of the structure of the active shutter lens 33 in the fourth state in the structure shown in FIG. 9 , and FIG. 10b is the structure shown in FIG. 9 The active shutter lens 33 is in the second state Below is the schematic diagram of the structure. It should be noted that, in the drawings of the present application, the straight line with arrows at both ends shown in the circle on the left side of the drawing represents the polarization state of the light at this position, and the description of the drawings in the following can be understood in the same way.

In one embodiment, the active shutter lens 33 is a TN type liquid crystal light valve.

When the processor 34 turns on the active shutter glass 33, that is, when the active shutter glass 33 is in the fourth state, the liquid crystal light valve is in a power-off state, that is, the voltage difference between the two sides of the liquid crystal layer in the liquid crystal cell 331 is zero. The ambient light Lc enters the liquid crystal cell 331 after being filtered by the first polarizer 332. At this time, the liquid crystal molecules in the liquid crystal cell 331 are in a spiral shape, and the liquid crystal cell 331 delays the phase of the light emitted by the first polarizer 332 by π. The plate 333 is perpendicular to the light transmission axis of the first polarizer 332 , and the light emitted by the liquid crystal cell 331 can pass through the second polarizer 333 and be directed towards the outer surface 313 of the combiner 31 . That is, the ambient light Lc can pass through the active shutter lens 33 and enter the human eye from the inner surface 312 of the combiner 31 for imaging, so as to ensure that the user can observe the real scene outside. At this time, the natural light transmittance of the active shutter lens 33 is between 35% and 50%.

When the processor 34 closes the active shutter glass 33, that is, when the active shutter glass 33 is in the second state, the liquid crystal light valve is in the power-on state at this time, that is, there is a voltage difference between the two sides of the liquid crystal layer in the liquid crystal cell 331, and the liquid crystal in the liquid crystal layer It rotates to be perpendicular to the first polarizer 33 . The ambient light LC enters the liquid crystal cell 331 after being filtered by the first polarizer 332. At this time, the liquid crystal molecules in the liquid crystal cell 331 are upright, and the liquid crystal cell 331 does not change the phase of the light emitted by the first polarizer 332. 333 is perpendicular to the light transmission axis of the first polarizer 332 , and the light emitted by the liquid crystal cell 331 cannot pass through the second polarizer 333 to the outer surface 313 of the combiner 31 , so it is completely blocked by the second polarizer 333 . That is, the ambient light LC cannot pass through the active shutter glass 33 . That is, the active shutter lens 33 completely absorbs the ambient light LC.

In another embodiment, the active shutter lens 33 is an IPS type liquid crystal light valve.

When the augmented reality device 100 shown in this embodiment is worn on the user's head, and the processor 34 turns on the active shutter lens 33, that is, when the active shutter lens 33 is in the fourth state, the liquid crystal light valve is in the power-on state at this time, and the liquid crystal There is a voltage difference across the liquid crystal layer in the cell 331 . The ambient light LC enters the liquid crystal cell 332 after being filtered by the first polarizer 332. At this time, the liquid crystal molecules in the liquid crystal cell 331 are in a spiral shape, and the liquid crystal cell 331 retards the phase of the light emitted by the first polarizer 332 by π, which is equivalent to the liquid crystal cell 331 rotates the polarization direction of the light emitted by the first polarizer 332 by 90 degrees. Since the second polarizer 333 is perpendicular to the transmission axis of the first polarizer 332 , the light emitted from the liquid crystal cell 331 can pass through the second polarizer 333 and be directed toward the outer surface 313 of the combiner 31 . That is, the ambient light Lc can pass through the active shutter lens 33 and enter the human eye from the inner surface 312 of the combiner 31 for imaging, so as to ensure that the user can observe the real scene outside.

When the processor 34 closes the active shutter glass 33, that is, when the active shutter glass 33 is in the second state, the liquid crystal light valve is in a power-off state, and the voltage difference between the two sides of the liquid crystal layer in the liquid crystal cell 331 is zero. The ambient light LC enters the liquid crystal cell 331 after being filtered by the first polarizer 332 , and the liquid crystal cell 331 does not change the phase of the light emitted by the first polarizer 332 . Since the second polarizer 333 is perpendicular to the transmittance axis of the first polarizer 332 , the light emitted from the liquid crystal cell 331 cannot pass through the second polarizer 333 to the outer surface 313 of the combiner 31 , and is therefore blocked by the second polarizer 331 . 333 completely blocked. That is, the ambient light LC cannot pass through the active shutter glass 33 . That is, the active shutter lens 33 completely absorbs the ambient light LC.

It should be understood that, in other embodiments, the active shutter lens 33 can also be a VA type liquid crystal light valve, a super twisted nematic liquid crystal light valve or an FLC type liquid crystal light valve.

Next, for ease of understanding, the working states of the tunable grating 316 , the image projector 32 and the active shutter lens 33 in various time periods when the augmented reality device 100 shown in this embodiment is working will be illustrated by example. The description is given by taking the time period 0-t12 as an example. The 0-t12 time period includes 12 time periods with a duration of Δt. That is, tn-tn-1=Δt, and n is an integer of 1 or more and 12 or less.

Please refer to FIG. 11 . FIG. 11 is a schematic diagram of the working state of the tunable grating 316 , the image projector 32 and the active shutter lens 33 when the augmented reality device 100 shown in FIG. 9 is in operation.

In this embodiment, when the augmented reality device 100 is working, in the time periods of 0-t1, t2-t3, t4-t5, t6-t7, t8-t9, and t10-t11, the processor 34 performs the first operation, and the processor 34 Turn on the image projector 32, adjust the tunable grating 316 to the first state, and adjust the active shutter lens 33 to the second state to eliminate the rainbow effect and ensure that the display light projected by the image projector 32 will not be affected by the augmented reality leaked from device 100. During the time periods t1-t2, t3-t4, t5-t6, t7-t8, t9-t10, and t11-t12, the processor 34 performs a second operation, the processor 34 turns off the image projector 32, and the tunable grating 316 After adjusting the third state and adjusting the active shutter lens 33 to the fourth state, the human eye can see the real scene outside through the active shutter lens 33 and the combination 31 . In other words, the time periods 0-t1, t2-t3, t4-t5, t6-t7, t8-t9 and t10-t11 are the first periods mentioned above, t1-t2, t3-t4, t5-t6 , t7-t8, t9-t10, and t11-t12 time periods are the second time periods mentioned above. The time periods 0-t2, t2-t4, t4-t6, t6-t8, t8-t10, and t10-t12 are all one cycle T mentioned above, and T=2Δt.

At this time, in the period of 0-t12, the total duration of the image projector 32 in the ON state (ie, the active shutter lens 33 in the OFF state) is 6Δt, and the duration ratio is 50%. When the image projector 32 is turned off (ie, when the active shutter lens 33 is turned on), the total duration is 6Δt, and the percentage of the duration is 50%. That is, the transmittance of the augmented reality device 100 is between 17.5% and 25%.

It can be understood that, in the augmented reality device 100 shown in this embodiment, the time of the grating 316 in the first state and the third state can be tuned by adjusting the time ratio of the image projector 32 in the on and off states. The ratio, that is, the active shutter lens 33 is in the second state and the fourth state, is used to adjust the transmittance of the augmented reality device 100 . For example, when the duration of the image projector 32 in the on state accounts for 20% of the duration of the entire cycle, that is, when the duration of the image projector 32 in the off state accounts for 80% of the duration of the entire cycle, the augmented reality The transmittance of the device 100 is reduced by 20%, that is, the transmittance of the augmented reality device 100 is between 28% and 40%, that is, the rainbow effect can be eliminated and shielded under the premise of ensuring the transmittance of the augmented reality device 100 The leaked light L2 of the combiner 31 .

It should be noted that, in practical applications, since the response time (millisecond level) of closing the liquid crystal light valve is much longer than the response time (microsecond level or nanosecond level) of opening the image projector 32, in order to ensure that the active shutter lens 33 can In order to block the leaked light L2 effectively and timely, the time when the active shutter lens 33 is adjusted to the second state should be no later than the time when the tunable grating 316 is adjusted to the first state and the image projector 32 is turned on. That is, the time point when the active shutter glass 33 is adjusted to the second state should be earlier than the time point when the tunable grating 316 is switched to the first state and the image projector 32 is turned on, or the time point when the active shutter glass 33 is adjusted to the second state It should be the same point in time when the tunable grating 316 is adjusted to the first state and the image projector 32 is turned on. Assuming that the response time of the liquid crystal light valve is tr, the time when the active shutter glass 33 is adjusted to the second state needs to be earlier than the time when the image projector 32 is turned on by tr.

In this embodiment, the closing response time of the liquid crystal light valve is about 1ms-2ms, that is, the active shutter lens 33 can be closed 1ms-2ms before the tunable grating 316 is adjusted to the first state and the image projector 32 is turned on, so as to ensure the active shutter. The lens 33 can completely block the leaked light L2 in time.

Please refer to FIG. 12 . FIG. 12 is an enlarged schematic structural diagram of the A region in the structure shown in FIG. 3 under the third embodiment.

The enhanced display components of the enhanced display device include a combiner 31 , an image projector 32 , an active shutter glass 33 and a processor 34 . The coupler 31 is attached to the frame 10 . The active shutter glass 33 is mounted on the outer surface of the combiner 31, the image projector 32 is mounted on the frame 10, and the processor 34 couples the combiner 31, the image projector 32 and the active shutter glass 33.

The difference between the augmented reality device shown in this embodiment and the augmented reality device 100 shown in the second embodiment above is that the augmented reality device 100 further includes a quarter wave plate 40 (also known as a quarter retardation plate) , the quarter-wave plate 40 covers the surface of the first polarizer 332 facing away from the liquid crystal cell 331 , that is, the quarter-wave plate 40 covers the outer surface of the first polarizer 332 . Among them, the quarter wave plate is a birefringent single crystal wave plate with a certain thickness. When light passes through the quarter-wave plate, birefringence occurs and is divided into ordinary light and extraordinary light. The ordinary light is the light that obeys the law of refraction, and the extraordinary light is the light that does not obey the law of refraction. The phase difference between extraordinary lights is equal to π/2 or its odd multiples. In this embodiment, the quarter-wave plate 40 is an achromatic quarter-wave plate, that is, the phase delay of the wave plate to the visible light band is π/2, so as to ensure that the visible light in the ambient light can enter the human body. eye imaging.

Please also refer to FIG. 13 . FIG. 13 is a schematic structural diagram of the active shutter lens 33 and the quarter-wave plate 40 in the structure shown in FIG. 12 .

In this embodiment, the included angle between the direction of the fast axis of the quarter-wave plate 40 and the direction of the light transmission axis of the first polarizer 332 is 45 degrees. That is, the angle between the fast axis of the quarter-wave plate 40 and the polarization direction of the linearly polarized light that can pass through the first polarizer 332 is set to be 45 degrees. It should be understood that since many electronic screens commonly used in life are liquid crystal displays (LCDs), the light emitted from the liquid crystal displays is linearly polarized light. When the augmented reality device 100 shown in this embodiment is worn on the user's head, the electronic screen is viewed through the augmented reality device 100 and the line of sight rotates around the electronic screen, regardless of the polarization state of the light emitted from the electronic screen and the polarizer 332 The direction of the light transmission axis is vertical or parallel, and the quarter-wave plate 40 will turn the linearly polarized light emitted from the electronic screen into circularly polarized light, and attenuate the emitted light of the electronic screen by 50%. When the processor turns on the active shutter lens 33, the first polarizer 332 converts the circularly polarized light into linearly polarized light and enters the liquid crystal cell 331, and then enters the human eye through the liquid crystal cell 331 and the combiner 31, reducing the time when the user watches the electronic screen. The existing brightness difference helps to improve the user's experience when wearing the augmented reality device 100 to watch the electronic screen.

That is to say, when the augmented reality device 100 shown in this embodiment is worn on the head of the user, the augmented reality device 100 does not need to be removed, and the active shutter lens 33 only needs to be opened to view the electronic screen of the surrounding environment, which improves the Ease of use of the augmented reality device 100 .

In this embodiment, the active shutter lenses 33 of the two augmented reality components 30 both include a liquid crystal cell 331 , a first polarizer 332 and a second polarizer 333 . The liquid crystal cell 331 is coupled to the processor 34 , the first polarizer 332 covers the outer surface of the liquid crystal cell 331 , and the second polarizer 333 covers the inner surface of the liquid crystal cell 331 . When the processor 34 opens the active shutter lens 33, the ambient light Lc can pass through the liquid crystal cell 331 and the second polarizer 333 in sequence after being filtered by the first polarizer 332 to the outer surface 313 of the combiner 31, and self-combine The inner surface 312 of the device 31 is directed to the human eye, so that both the user's left and right eyes can view the real environment of the outside world through the active shutter lens 33 and the combination device 31 .

Specifically, there are two quarter wave plates 40 . A quarter wave plate 40 covers the outer surface of a first polarizer 332 , and the included angle between the fast axis direction and the light transmission axis direction of the first polarizer 332 is 45 degrees. The other quarter-wave plate 40 covers the outer surface of the other first polarizer 332 , and the included angle between its fast axis direction and the polarization direction of the first polarizer 332 is 45 degrees. That is to say, the included angle between the fast axis direction of each quarter wave plate 40 and the light transmission axis direction of the first polarizer 332 covered by it is 45 degrees, so as to ensure that the user is wearing the augmented reality device 100 to watch electronic When the two eyes rotate around the electronic screen, the difference in brightness of the electronic screen viewed by the two eyes is small, which improves the comfort of the user wearing the augmented reality device 100 to watch the electronic screen.

Wherein, the transmittance axes of the two first polarizers 332 are in the same direction, and the angle between the fast axis directions of the two quarter-wave plates 40 is 90 degrees, or the transmittance of the two first polarizers 332 is 90 degrees. The included angle between the axis directions is 90 degrees, and the fast axis directions of the two quarter-wave plates 40 are the same, so as to ensure that the two augmented reality components 30 respectively pass polarized light whose polarization directions are perpendicular to each other, such as left-handed polarized light and right-handed polarized light. The polarized light is rotated, so that the augmented reality device 100 can also be used in a three-dimensional (three-dimensional, 3D) movie theater. That is to say, the augmented reality device 100 shown in this embodiment can not only be used to watch a display screen combining virtual and real, but also can watch a 3D video when the processor 34 turns on the active shutter lens 33 . That is, the augmented reality device 100 can be compatible with both polarized and active shutter projection methods.

Please refer to FIG. 14 . FIG. 14 is an enlarged schematic structural diagram of the area A in the structure shown in FIG. 3 under the fourth embodiment.

The difference between the augmented reality device shown in this embodiment and the above-mentioned first augmented reality device 100 is that the augmented reality device 100 further includes a zoomer 50 . The zoomer 50 is installed on the inner surface 312 of the combiner 31 and covers the combiner 31 . the inner surface 312 of the device 31 . That is, the zoomer 50 is located on the side of the combiner 31 close to the human eye, so as to correct the vision of the user.

When the user suffers from vision problems such as nearsightedness, farsightedness, or astigmatism, the zoom device 50 can correct the user's refractive error when the user watches a virtual scene carrying digital content or an external real scene, so as to improve the user's viewing of the virtual scene or the external real scene The clarity at the time of use improves the user's experience of using the augmented reality device 100 . The zoom device 50 may be a device that can achieve zoom, such as a liquid crystal lens, a liquid lens, an Alvarez lens, or a mechanical zoom lens. It should be understood that the zoom device 50 may be an optical device with a fixed power such as a lens having a power, or an optical device with adjustable power coupled with the processor 34 , and the user can use the augmented reality device 100 according to the The user's diopter adjusts the optical power of the zoomer 50 to match the user's eyesight, so as to improve the adaptability of the augmented reality device 100 , thereby improving the use flexibility of the augmented reality device 100 .

Please refer to FIG. 15. FIG. 15 is an enlarged schematic structural diagram of the area A in the structure shown in FIG. 3 under the fifth embodiment.

The difference between the augmented reality device 100 shown in this embodiment and the above-mentioned third augmented reality device 100 is that the augmented reality device 100 further includes an eye tracking component 60 . The eye tracking component 60 is mounted on the frame 10 for tracking the sight of the eye. The processor 34 is coupled to the zoomer 50 and the eye tracking component 60 for adjusting the optical power of the zoomer 50 .

In this embodiment, the eye tracking component 60 is installed on the frame 11 of the frame 10 and faces the inner side of the frame 11 . Wherein, the eye tracker 60 includes one or more infrared light-emitting diodes (infrared light-emitting diode, IR LED) 61 and one or more infrared cameras (infrared camera, IR camera) 62. Specifically, the infrared light emitting diode 61 is mounted on the first frame 131 and faces the inner side of the mirror frame 11 . The infrared camera 62 is mounted on the second frame 133 and faces the inner side of the lens frame 11 . The infrared light emitting diode 61 emits infrared light, the infrared light enters the user's eyeball, is reflected by the user's cornea and then enters the infrared camera 52 for imaging. Determines the direction of the user's gaze after calibration. It should be noted that the eye tracker 60 shown in this embodiment is not limited to the above-mentioned eye tracking technology, and other eye tracking technologies are acceptable, which is not specifically limited in this application.

When the processor 34 performs the first operation, turns off the image projector 32, adjusts the tunable grating 316 to the first state, and adjusts the power of the zoom 50 to the first power, the tunable grating 316 is in the first state. In the first state, when the image projector 32 is in an off state and the optical power of the zoom device 50 is the first optical power, the zoom device 50 can correct the user's refractive error when the user is viewing the real scene outside, and improve the user's ability to The clarity when watching the real scene improves the user's experience. Wherein, when the user suffers from vision problems such as myopia, hyperopia, or astigmatism, the first optical power is the diopter of the user's eyeball.

When the processor 34 performs the second operation, the image projector 32 is turned on, and when the tunable grating 316 is adjusted to the second state, the tunable grating 316 is in the second state, and when the image projector 32 is in the on state, the eye tracking component 60 The vergence depth of the virtual scene viewed by the eyeball is acquired, and the processor 34 adjusts the optical power of the zoomer 50 to the second optical power according to the acquisition result of the eye tracking component 60 . Specifically, the eye tracking component 60 tracks the line of sight of the eye, and determines the vergence depth of the virtual scene observed by the user according to the direction of the user's line of sight. The processor 34 changes the virtual image distance of the virtual scene according to the vergence depth, and adjusts the position of the virtual scene to this vergence depth. The second refractive power is the sum of the inverse of the first refractive power and the virtual image depth observed by the user. At this time, the zoom device 50 can not only correct the refractive error of the user when the user observes the virtual digital content, improve the clarity of the user when viewing the digital content, and improve the user's use experience, but also can change the virtual image distance of the digital content to solve the problem of visual convergence adjustment. Conflict (vergence-accommodation conflict, VAC), reduces the user's discomfort when using the augmented reality device 100, and improves the user's comfort when using the augmented reality device 100.

Next, for ease of understanding, when the augmented reality device 100 is working, the working states of the tunable grating 316 , the image projector 32 , the active shutter lens 33 and the zoomer 50 in various time periods are illustrated. Wherein, in the time period 0-t12, the user's eyes have a refractive error of D0 (eg -4.0D) as an example for description.

Please refer to FIG. 16 . FIG. 16 is a schematic diagram of the working state of the tunable grating 316 , the image projector 32 , the active shutter lens 33 and the zoomer 50 when the augmented reality device 100 shown in FIG. 15 is in operation.

In this embodiment, when the augmented reality device 100 is working, in the time periods of 0-t1, t2-t3, t4-t5, t6-t7, t8-t9, and t10-t11, the processor 34 performs the first operation, which can tune The grating 316 is in the first state, the image projector 32 is in the on state, the active shutter lens 33 is in the second state, and the processor 34 determines that the depth of the virtual image observed by the user is L (eg, 0.5 m) according to the direction of the user's sight line obtained by the eye tracker 60 . ), the reciprocal ΔD of the virtual image depth is 1/L (eg -2.0D), and the optical power of the zoom device 50 is adjusted to D0+ΔD (eg -6.0D). At this time, the second optical power of the zoomer 50 is D0+ΔD, which not only ensures that the display light projected by the image projector 32 will not leak out of the augmented reality device 100, but also ensures that the user can clearly view the digital content.

During time periods t1-t2, t3-t4, t5-t6, t7-t8, t9-t10, and t11-t12, processor 34 performs a second operation, tunable grating 316 is in a third state, and image projector 32 is in a In the closed state, and the active shutter lens 33 is in the fourth state, the processor 34 adjusts the optical power of the zoom device 50 to D0. At this time, the first optical power of the zoom device 50 is D0 to ensure that the human eye can clearly see the real scene outside through the active shutter lens 33 and the combiner 31 .

The present application further provides a display method for any one of the above-mentioned augmented reality devices 100 , including: performing the first operation and the second operation alternately. Specifically, the processor 34 alternately performs the first operation and the second operation.

In the first period, the first operation is performed, the image projector 32 is turned on, the tunable grating 316 is adjusted to the first state, and the active shutter lens 33 is adjusted to the second state, and the image projector 32 projects display light to the combiner 31 L0, part of the display light L0 is emitted from the inner surface 312 of the combiner 31, part of the display light L0 is emitted from the outer surface 313 of the combiner 31, and the ambient light Lc is directed to the outer surface of the active shutter lens 33, and the active shutter lens 33 blocks the self-combination The display light L0 emitted from the outer surface 313 of the shutter 31 and the ambient light Lc emitted to the outer surface of the active shutter lens 33 are included.

Specifically, the processor 34 performs the first operation, turns on the image projector 32 , adjusts the tunable grating 316 to the first state, and adjusts the active shutter glass 33 to the second state. The active shutter glass 32 prevents the self-combiner 31 The display light L0 emitted from the outer surface 313 of the device is injected into the external environment, preventing the display light L0 carrying digital content from leaking out, which can not only improve the privacy of the user and the sociality of the augmented reality device 100, but also avoid the leakage of the display light L0. The display light L0 forms a small display window on the surface of the augmented reality device 100 to improve the appearance of the user when the augmented reality device 100 is used. In addition, the active shutter lens 33 also prevents the ambient light Lc from hitting the tunable grating 316, eliminating the rainbow effect.

In the second period, the second operation is performed, the image projector 32 is turned off, the tunable grating 316 is adjusted to the third state, and the active shutter glass 33 is adjusted to the fourth state. After the ambient light Lc passes through the active shutter glass 33, It enters the coupler 31 from the outer surface 313 of the coupler 31 and exits from the inner surface 312 of the coupler 31 .

Specifically, the processor 34 performs the first operation, turns off the image projector 32, adjusts the tunable grating 316 to the third state, and adjusts the active shutter glass 33 to the fourth state, and the user can pass through the combiner 31 and the active shutter The lens 33 sees the real scene in the outside world, so as to ensure that the augmented reality device 100 has a certain transmittance. Wherein, the length of the second period is equal to the length of the first period. It should be noted that, in other embodiments, the length of the second time period may also be greater than or less than the length of the first time period, which is not specifically limited in this application.

In this embodiment, the first period and the second period are alternately performed. Wherein, the first period and the second period form a period, and one period is less than or equal to 1/60 second. It is important to understand that the flickering frequency perceivable by the human eye is 60Hz. Since a period is less than or equal to 1/60 of a second. That is, 1 second includes at least 60 cycles. That is, the first period and the second period appear at least 60 times within 1 second. At this time, the alternating frequency of the first period and the second period is greater than 120Hz. According to the phenomenon of persistence of vision (also known as the phenomenon of visual pause or afterglow effect), the human eye cannot perceive the switching between the virtual scene and the real scene outside, which is quite The human eye can not only see the existence of virtual scenes, but also see the existence of real scenes in the outside world. That is, on the premise of ensuring the transmittance of the augmented reality device 100, not only the rainbow effect is eliminated, but also the display light L0 leaked from the substrate can be blocked.

It should be noted that, in the display method of the augmented display device shown in this embodiment, the transmittance of the augmented reality device 100 may be adjusted by adjusting the time ratio of the first time period and the second time period. For example, when the time of the first period accounts for 20% of the entire cycle, the transmittance of the augmented reality device 100 only drops by 20%, that is, on the premise of ensuring the transmittance of the augmented reality device 100, not only does it eliminate the The rainbow effect also realizes the shielding of the leaked light L2 of the combiner 31, which improves the user experience.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. should be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

An augmented reality device, characterized in that it comprises a frame, a combiner, an active shutter lens, an image projector and a processor, the combiner is mounted on the frame, the combiner comprises a tunable grating, the The active shutter lens is mounted on the outside of the combination and covers the tunable grating, the image projector is mounted on the lens frame, and the processor is coupled to the tunable grating, the active door lens and all the the image projector for alternately performing the first operation and the second operation;

Wherein, the first operation includes turning on the image projector, adjusting the tunable grating to a first state, and adjusting the active shutter lens to a second state, and the image projector reports to the combiner Projecting display light, the display light is diffracted at the tunable grating to form diffracted light, part of the diffracted light is directed to the inner side of the combiner, and the active shutter lens blocks the ambient light directed to the tunable grating;

The second operation includes turning off the image projector, adjusting the tunable grating to a third state, and adjusting the active shutter glass to a fourth state through which ambient light passes through the active shutter glass and the After the tunable grating, it shoots towards the inside of the combiner.
The augmented reality device according to claim 1, wherein the processor is configured to perform the first operation in a first time period, and is further configured to perform the second operation in a second time period, the first time period and the second period to form a period, and the period is less than or equal to 1/60 of a second.
The augmented reality device of claim 1 or 2, wherein the active shutter lens covers the coupler.
The augmented reality device according to any one of claims 1-3, wherein the active shutter lens comprises a liquid crystal cell coupled to the processor, a liquid crystal cell located on a side of the liquid crystal cell away from the coupler The first polarizer and the second polarizer located between the liquid crystal cell and the substrate, the included angle between the light transmission axis directions of the first polarizer and the second polarizer is 90 degrees.
The augmented reality device according to claim 4, wherein the augmented reality device further comprises a quarter wave plate, the quarter wave plate is mounted on the outer surface of the first polarizer, and The included angle between the direction of the fast axis of the quarter-wave plate and the direction of the light transmission axis of the first polarizer is 45 degrees.
The augmented reality device according to any one of claims 1-5, characterized in that, the augmented reality device comprises two augmented reality components, and the two augmented reality components are installed on the frame at intervals, each The augmented reality assembly includes the coupler, the image projector and the active shutter lens, the couplers of the two augmented reality components being arranged side by side.
6. The augmented reality device of claim 6, wherein the active shutter lens of each augmented reality component comprises a liquid crystal cell coupled to the processor, a liquid crystal cell located on a side of the liquid crystal cell away from the substrate a first polarizer and a second polarizer located between the liquid crystal cell and the substrate, between the first polarizer and the light transmission axis direction of the second polarizer of each augmented reality component The included angle is 90 degrees.
The augmented reality device according to claim 7, wherein the augmented reality device comprises two quarter-wave plates, one of the quarter-wave plates is mounted on the outer surface of one of the first polarizers surface, and the included angle between the fast axis direction of one of the quarter wave plates and the light transmission axis direction of one of the first polarizers is 45 degrees, and the other quarter wave plate is installed on the The included angle between the outer surface of the other first polarizer and the fast axis direction of the other quarter wave plate and the light transmission axis direction of the other first polarizer is 45 degrees.
The augmented reality device according to claim 8, wherein the light transmission axis directions of the two first polarizers are the same, and the included angle between the fast axis directions of the two quarter wave plates is 90 degrees, or, the included angle between the light transmission axis directions of the two first polarizers is 90 degrees, and the fast axis directions of the two quarter wave plates are the same.
The augmented reality device according to any one of claims 1-9, characterized in that, the augmented reality device further comprises a zoomer, and the zoomer is installed on the inner side of the combiner.
The augmented reality device according to claim 10, wherein the augmented reality device further comprises an eye-tracking component, the eye-tracking component is mounted on the frame, and the processor is further coupled to the zoomer and the described eye tracking component;

The processor is configured to turn off the image projector and adjust the optical power of the zoom device to a first optical power;

The processor is used to turn on the image projector, the eye tracking component is used to obtain the vergence depth of the virtual scene viewed by the eye, and the processor adjusts the optical focus of the zoom according to the result obtained by the eye tracking component. degree is adjusted to the second optical power.
A display method of an augmented reality device, characterized in that the augmented reality device comprises a frame, a combiner, an active shutter lens and an image projector, the combiner is mounted on the frame, and the combiner includes a A tuning grating, the active shutter lens is mounted on the outside of the combiner and covers the tunable grating, the image projector is mounted on the mirror frame, and the display method of the augmented reality device includes:

Alternately perform the first operation and the second operation;

Wherein, the first operation includes turning on the image projector, adjusting the tunable grating to a first state, and adjusting the active shutter lens to a second state, and the image projector projects to the substrate Display light, the display light is diffracted at the tunable grating to form diffracted light, part of the diffracted light is directed to the inner side of the combiner, and the active shutter lens blocks the ambient light directed to the tunable grating;

The second operation includes turning off the tunable grating, adjusting the tunable grating to a third state, and adjusting the active shutter glass to a fourth state, with ambient light passing through the active shutter glass and the After the tunable grating, it shoots towards the inside of the combiner.
The display method of an augmented reality device according to claim 12, wherein in a first period, the first operation is performed, and in a second period, the second operation is performed, and the first period and the The second period forms a period that is less than or equal to 1/60 of a second.