CN115145028A

CN115145028A - Augmented reality device and display method thereof

Info

Publication number: CN115145028A
Application number: CN202110350866.5A
Authority: CN
Inventors: 朱帅帅
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-03-31
Filing date: 2021-03-31
Publication date: 2022-10-04
Also published as: WO2022206638A1

Abstract

An augmented reality device includes a frame, a coupler, an active shutter lens, an image projector, and a processor. The coupler is mounted to the frame, the active shutter lens is mounted to an outer side of the coupler and covers the tunable grating of the coupler, and the image projector is mounted to the frame for alternately performing the first operation and the second operation. The first operation comprises starting the image projector, adjusting the tunable grating to a first state, adjusting the active shutter lens to a second state, projecting display light to the combiner by the image projector, diffracting the display light at the tunable grating to form diffracted light, emitting part of the diffracted light to the inner side of the combiner, and blocking ambient light emitted to the tunable grating by the active shutter lens. The second operation includes turning off the image projector, adjusting the tunable grating to a third state, and adjusting the active shutter lens to a fourth state, wherein the ambient light is emitted to the inner side of the combiner after passing through the active shutter lens and the tunable grating.

Description

Augmented reality device and display method thereof

Technical Field

The application relates to the field of virtual and real combined display, in particular to augmented reality equipment and a display method thereof.

Background

The principle of the AR technology is to project display light rays carrying digital content into human eyes by using a computer-controlled image projector to form a virtual scene, and superimpose the virtual scene and an external real scene that can be directly seen by the human eyes, so that the human eyes view image information combining the virtual scene and the external real scene.

In traditional augmented reality equipment, when ambient light passed through the coupling-out grating and got into the people's eye, because the diffraction effect of coupling-out grating, the light of different wavelengths can take place the diffraction at coupling-out grating department, has the light of multiple colour to penetrate into the people's eye and causes the rainbow effect (rainbow effect), has reduced user's use and has experienced.

Disclosure of Invention

The application provides augmented reality equipment and a display method thereof, which are used for eliminating a rainbow effect and improving the use experience of a user.

In a first aspect, the present application provides an augmented reality device, including a frame, a coupler, an active shutter lens, an image projector, and a processor, wherein the coupler is mounted to the frame, the coupler includes a tunable grating, the active shutter lens is mounted to an outer side of the coupler and covers the tunable grating, the image projector is mounted to the frame, and the processor couples the tunable grating, the image projector, and the active shutter lens for alternately performing a first operation and a second operation.

The first operation comprises starting the image projector, adjusting the tunable grating to a first state, and adjusting the active shutter lens to a second state.

At this time, the image projector projects display light to the combiner. The display light is a light carrying digital content. Show that light takes place the diffraction at tunable grating and forms diffraction light, the inboard of part diffraction light directive connector, the outside of part diffraction light directive connector, the diffraction light in the outside of directive connector is sheltered from to the initiative shutter lens, prevent that the diffraction light in the outside of directive connector from passing initiative shutter lens directive external environment, the diffraction light of avoiding carrying digital content reveals away, not only can improve user's privacy nature and augmented reality equipment's sociality, can also avoid revealing the little display window of diffraction light formation on augmented reality equipment's surface of going out, the appearance exquisite degree when the user uses augmented reality equipment is improved.

In addition, the active shutter lens shields the ambient light of the tunable grating, prevents the ambient light of the tunable grating from being diffracted at the tunable grating, avoids rainbow effect caused by the fact that light of various colors enters human eyes, and improves the use experience of users.

The second operation includes turning off the image projector, adjusting the tunable grating to a third state, and adjusting the active shutter lens to a fourth state.

At this time, the image projector does not project the display light to the combiner. Ambient light rays penetrate through the active shutter lens and the tunable grating and then irradiate to the inner side of the combiner, so that a user can see an external real scene through the combiner and the active shutter lens, and the augmented reality device is guaranteed to have a certain transmittance.

The inner side of the combiner refers to a surface of the combiner facing the user when the augmented reality device is worn on the head of the user. That is, the inner side of the coupler is the side of the coupler facing the human eye. That is, the human eye is located inside the combiner. Similarly, the outer side of the combiner refers to the side of the combiner facing away from the user when the augmented reality device is worn on the head of the user. I.e. the outer side of the coupler is the side of the coupler facing away from the human eye. That is, the outer side of the coupler is the side of the coupler facing the outside.

Wherein the tunable grating is an optical device that can be switched on and off under the control of a processor. The processor starts the tunable grating, namely when the tunable grating is in a first state, the tunable grating is equivalent to a diffraction grating, and light can be diffracted on the tunable grating. The processor closes the tunable grating, namely when the tunable grating is in the third state, the tunable grating is equivalent to a transparent plate body, and light can continue to propagate through the tunable grating, namely the light cannot be diffracted at the tunable grating.

The active shutter lens is a lens which can be rapidly opened and closed under the control of a processor. When the processor opens the active shutter lens, that is, the active shutter lens is in the fourth state, the transmittance of the active shutter lens is high, and light can normally propagate through the active shutter lens. The processor closes the active shutter lens, that is, when the active shutter lens is in the second state, the transmittance of the active shutter lens is close to 0, and the active shutter lens can block light, that is, the light can hardly pass through the active shutter lens to normally propagate, that is, the active shutter lens can absorb the light.

In one embodiment, the processor is configured to perform a first operation during a first time period and is further configured to perform a second operation during a second time period. The first period and the second period form a cycle, and the cycle is less than or equal to 1/60 second.

It is to be understood that the flicker frequency perceivable to the human eye is 60Hz. Because one period is less than or equal to 1/60 second, that is, one second at least comprises 60 periods, according to a persistence of vision phenomenon (also called a pause of vision phenomenon or an afterglow effect), human eyes cannot perceive the switching between the virtual scene and the external real scene, which is equivalent to that human eyes can see both the existence of the virtual scene and the existence of the external real scene. That is, the rainbow effect can be eliminated on the premise of ensuring the transmittance of the augmented reality device, and the display light leaked from the combiner can be shielded.

In one embodiment, the outer surface of the coupler includes a functional region, ambient light directed to the tunable grating is incident from the functional region of the outer surface of the coupler, diffracted light directed to the outside of the coupler is emitted from the light-emitting region of the outer surface of the coupler, and the active shutter lens covers the light-emitting region of the outer surface of the coupler. When the processor starts the tunable grating and the image projector and closes the active shutter lens, the ambient light emitted to the tunable grating cannot emit to the inner side of the combiner, so that the ambient light is prevented from being diffracted at the tunable grating, and the rainbow effect is avoided. In addition, the diffraction light rays emitted to the outer side of the combiner cannot be emitted into the external environment, and the display light rays carrying digital contents are prevented from being leaked.

In another embodiment, the active shutter glasses cover the coupler, and the active shutter glasses cover the outer surface of the coupler, so as to ensure the appearance integrity and consistency of the augmented reality device and improve the appearance delicacy of the augmented reality device. In addition, compared with the mode that the active shutter lens only covers the functional area of the outer surface of the connector, the active shutter lens covers the outer surface of the connector, the assembling process difficulty of the active shutter lens is reduced, additional processing of the active shutter lens is not needed, the processing difficulty of the active shutter lens is reduced, and the production cost of the active shutter lens is reduced.

In one embodiment, the active shutter glasses are liquid crystal light valves, and the active shutter glasses include a liquid crystal cell, a first polarizer and a second polarizer, wherein the liquid crystal cell is coupled to the processor, the first polarizer is located on a side of the liquid crystal cell away from the combiner, and the second polarizer is located between the liquid crystal cell and the combiner. I.e. the second polarizer is located on the side of the liquid crystal cell facing away from the first polarizer, i.e. the second polarizer is located on the side of the liquid crystal cell facing away from the combiner. The included angle between the transmission axis directions of the second polarizer and the first polarizer is 90 degrees. When the active shutter lens is opened by the processor, ambient light is filtered by the first polaroid, then sequentially passes through the liquid crystal box and the second polaroid to be emitted to the outer surface of the combiner, and is emitted to human eyes from the inner surface of the combiner, so that the human eyes can see the external real environment through the active shutter lens and the combiner.

The liquid crystal light valve is an optical device which controls the refractive index of liquid crystal molecules through voltage to realize phase delay of light.

In one embodiment, the active shutter glasses are in-plane switching (IPS) liquid crystal light valves.

When the processor opens the active shutter lens, namely the processor adjusts the active shutter lens to a fourth state, the liquid crystal light valve is in a power-on state, ambient light enters the liquid crystal box after being filtered by the first polaroid, the liquid crystal box delays the phase of light emitted by the first polaroid by pi, and the light emitted by the liquid crystal box can penetrate through the second polaroid to emit to the outer surface of the combiner due to the fact that the transmission axis directions of the second polaroid and the first polaroid are perpendicular to each other.

When the processor closes the active shutter lens, namely the processor adjusts the active shutter lens to the second state, the liquid crystal light valve is in the power-off state, ambient light enters the liquid crystal box after being filtered by the first polaroid, the liquid crystal box can not change the phase of light emitted by the first polaroid, and the light emitted by the liquid crystal box can not pass through the second polaroid to emit to the outer surface of the combiner because the light transmission axes of the second polaroid and the first polaroid are perpendicular to each other, so that the light can be completely blocked by the second polarized light.

In one embodiment, the active shutter glasses are Twisted Nematic (TN) type liquid crystal light valves.

When the processor opens the active shutter lens, namely the processor adjusts the active shutter lens to the fourth state, the liquid crystal light valve is in the power-off state, ambient light enters the liquid crystal box after being filtered by the first polaroid, the liquid crystal box can delay the phase of light emitted by the first polaroid by pi, and the light emitted by the liquid crystal box can penetrate through the second polaroid to emit to the outer surface of the combiner because the second polaroid is vertical to the transmission axis direction of the first polaroid.

When the processor closes the active shutter lens, namely the processor adjusts the active shutter lens to the second state, the liquid crystal light valve is in the power-on state, liquid crystal in the liquid crystal box can rotate to be in a state perpendicular to the first polaroid, ambient light enters the liquid crystal box after being filtered by the first polaroid, the liquid crystal box can not change the phase of light emitted by the first polaroid, and the light emitted by the liquid crystal box can not pass through the second polaroid to be emitted to the outer surface of the combiner because the second polaroid is perpendicular to the direction of the light transmission axis of the first polaroid, so that the light is completely blocked by the second polaroid.

In one embodiment, the liquid crystal light valve is a Vertical Alignment (VA) type liquid crystal light valve, a Super Twisted Nematic (STN) type liquid crystal light valve, or a Ferroelectric Liquid Crystal (FLC) type light valve.

In one embodiment, the augmented reality device further includes a quarter-wave plate, the quarter-wave plate is installed on a surface of the first polarizer, which faces away from the liquid crystal light valve, that is, the quarter-wave plate is installed on an outer surface of the first polarizer, and an included angle between a fast axis direction of the quarter-wave plate and a transmission axis direction of the first polarizer is 45 degrees.

It should be understood that many conventional electronic screens are Liquid Crystal Displays (LCDs), and the light emitted from the LCD is linearly polarized light. When a user wears the augmented reality device shown in this embodiment to observe the electronic screen and the line of sight rotates around the electronic screen, no matter whether the polarization direction of the emergent light of the electronic screen is perpendicular or parallel to the transmission axis direction of the first polarizer, the quarter-wave plate can attenuate the linearly polarized light in any polarization direction to 50%, and when the processor opens the active shutter lens, the quarter-wave plate can reduce the brightness difference when the user watches the electronic screen, which is helpful for improving the use feeling when the user wears the augmented reality device to watch the electronic screen.

In one embodiment, the augmented reality device comprises two augmented reality components, the two augmented reality components are mounted on the mirror bracket at intervals, each augmented reality component comprises the combiner, the image projector and the active shutter lens, and the combiners of the two augmented reality components are arranged side by side.

In the augmented reality device shown in this embodiment, one augmented reality component corresponds to the left eye of the user, and the other augmented reality component corresponds to the right eye of the user. The structure of two augmented reality subassemblies is the same, and two augmented reality subassemblies are all under the prerequisite of the transmittance of guaranteeing augmented reality equipment promptly, avoid carrying digital content's display light to reveal away.

In one embodiment, the active shutter glass of each augmented reality device is a liquid crystal light valve, the active shutter glass of each augmented reality device includes a liquid crystal cell, a first polarizer and a second polarizer, the liquid crystal cell of each augmented reality device is coupled to the processor, the first polarizer of each augmented reality device is located on a side of the liquid crystal cell of the augmented reality device facing away from the combiner, and the second polarizer of each augmented display device is located between the liquid crystal cell of the augmented reality device and the combiner. That is, the second polarizer of each augmented reality assembly is located on a side of the liquid crystal cell of the augmented reality assembly facing away from the first polarizer, that is, the second polarizer of each augmented reality assembly is located on a side of the liquid crystal cell of the augmented reality assembly facing the combiner first polarizer. An included angle between the transmission axis directions of the first polaroid and the second polaroid of each augmented reality assembly is 90 degrees.

When the processor starts the active shutter lens, namely the processor adjusts the active shutter lens to the fourth state, ambient light is filtered by the first polaroid, then sequentially passes through the liquid crystal box and the second polaroid to be emitted to the outer surface of the combiner, and is emitted to human eyes from the inner surface of the combiner, so that the left eye and the right eye of an operator can observe the real environment outside.

In one embodiment, the augmented reality device includes two quarter-wave plates, one quarter-wave plate is installed on an outer surface of one first polarizer, an included angle between a fast axis direction of one quarter-wave plate and a transmission axis direction of one first polarizer is 45 degrees, the other quarter-wave plate is installed on an outer surface of the other first polarizer, and an included angle between a fast axis direction of the other quarter-wave plate and a transmission axis direction of the other first polarizer is 45 degrees, so that in a process that a user wears the augmented reality device to watch an electronic screen, brightness difference existing when the user watches the electronic screen by the left eye and the right eye is reduced, and the use feeling when the user wears the augmented reality device to watch the electronic screen is improved.

In one embodiment, the transmission axis directions of the two first polarizing plates are the same, the included angle between the fast axis directions of the two quarter-wave plates is 90 degrees, or the included angle between the transmission axis directions of the two first polarizing plates is 90 degrees, the fast axis directions of the two quarter-wave plates are the same, so that when a user wears the augmented reality device to watch an electronic screen, the two augmented reality components respectively pass through polarized light with mutually perpendicular polarization directions, for example, the polarized light respectively passes through left-handed polarized light and right-handed polarized light, and the two polarized light with mutually perpendicular polarization directions enter the left eye and the right eye of the user to form images respectively at the moment. When the processor turns on the active shutter glasses, that is, the processor adjusts the active shutter glasses to the fourth state, the user can view a three-dimensional (3D) image. That is, the augmented reality device according to this embodiment can be used in a 3D movie theater, and can simultaneously use two projection modes, i.e., a polarization mode and an active shutter mode.

In one embodiment, the augmented reality device further comprises a zoom, the zoom being mounted inside the combiner. That is, the zoom is located on a side of the combiner near the human eye to correct the vision of the user. When the user suffers from myopia, hyperopia or astigmatism and other vision problems, the zoom can correct ametropia of the user when the user watches a virtual scene or an external real scene, definition of the user when the user watches the virtual scene or the external real scene is improved, and use experience of the user using the augmented reality device is improved.

In one embodiment, the processor is coupled to the zoom, and the processor is configured to adjust the optical power of the zoom. When the user needs to use the augmented reality device, the processor can adjust the focal power of the zoom device to be matched with the vision of the user according to the diopter of the user so as to improve the adaptation degree of the augmented reality device and further improve the use flexibility of the augmented reality device.

In one embodiment, the augmented reality device further comprises an eye tracking assembly mounted to the frame for tracking a line of sight of the eye, the processor coupled to the zoom lens and the eye tracking assembly;

the processor is used for closing the image projector and adjusting the focal power of the zoom to be a first focal power so as to correct ametropia of the user when the user watches the external real scene and improve definition of the user when the user watches the external real scene;

the processor is used for starting the image projector, the eyeball tracking assembly is used for acquiring the convergence depth of the virtual scene watched by the eyeballs, and the processor adjusts the focal power of the zoom device to be the second focal power according to the acquisition result of the eyeball tracking assembly.

The utility model discloses a virtual scene, including the user, the virtual scene is fixed at the user, the processor is fixed at the virtual scene, the eyeball is tracked the subassembly and is used for tracking the sight of eyeball, and obtain the vergence degree of depth of the virtual scene that the user is gazing according to the sight of eyeball, the processor changes the virtual image distance of virtual scene according to this vergence degree of depth, with the position adjustment of virtual scene to this vergence degree of depth, not only can correct user's ametropia when the user observes virtual scene, improve the definition when the user observes virtual scene, can also solve visual vergence and adjust the conflict, reduce the uncomfortable sense when the user uses the reinforcing reality equipment, user's use comfort level is improved.

The first focal power is diopter of eyeballs of the user, and the second focal power is sum of the first focal power and reciprocal of depth of a virtual image observed by the user.

In one embodiment, the eyeball tracking assembly comprises one or more infrared light-emitting diodes and one or more infrared cameras, infrared light emitted by the infrared light-emitting diodes enters human eyes of users and is reflected into the infrared cameras through corneas of the human eyes to be imaged, the processor obtains the optical axis direction of the eyeballs of the users through the positions of light spots of the infrared light in the images, obtains the sight line direction of the users after calibrating the optical axis direction of the eyeballs, determines the depth of a virtual scene watched by the users according to the sight line direction of the users, and then adjusts the focal power of the zoom to the second focal power.

In a second aspect, the present application provides a display method of an augmented reality device. The enhanced display device comprises a frame, a coupler, an active shutter lens and an image projector, wherein the coupler is mounted on the frame, the coupler comprises a tunable grating, the active shutter lens is mounted on the outer side of the coupler and covers the tunable grating, and the image projector is mounted on the frame. The display method of the enhanced display device comprises the following steps: the first operation and the second operation are alternately performed.

At this time, the image projector projects display light to the coupler, the display light is diffracted at the tunable grating to form diffracted light, part of the diffracted light is emitted to the inner side of the coupler, and part of the diffracted light is emitted to the outer side of the coupler. The diffraction light that the outside of directive connector was sheltered from to the initiative shutter lens, prevents that the diffraction light in the outside of directive connector from passing initiative shutter lens directive external environment, avoids carrying the diffraction light of digital content and reveals away, not only can improve user's privacy nature and augmented reality equipment's sociality, can also avoid revealing the diffraction light of going out and form little display window on augmented reality equipment's surface, the appearance exquisite degree when improving the user and using augmented reality equipment.

In addition, the active shutter lens shields the ambient light rays emitted to the tunable grating, so that the ambient light rays emitted to the tunable grating are prevented from being diffracted at the tunable grating, rainbow effect caused by the fact that light rays with various colors are emitted into human eyes is avoided, and the use experience of a user is improved.

At this time, the image projector does not project the display light to the combiner. Ambient light irradiates to the inner side of the combiner after passing through the active shutter lens and the tunable grating, so that a user can see an external real scene through the combiner and the active shutter lens to ensure that the augmented reality device has certain transmittance.

In one embodiment, the first operation is performed during a first period of time and the second operation is performed during a second period of time, the first period of time and the second period of time forming a cycle, the cycle being less than or equal to 1/60 of a second.

It is to be understood that the flicker frequency perceivable to the human eye is 60Hz. Because one period is less than or equal to 1/60 second, that is, one second at least comprises 60 periods, according to a persistence of vision phenomenon (also called a pause of vision phenomenon or an afterglow effect), human eyes cannot perceive the switching between the virtual scene and the external real scene, which is equivalent to that human eyes can see both the existence of the virtual scene and the existence of the external real scene. That is, the rainbow effect can be eliminated on the premise of ensuring the transmittance of the augmented reality device, and the display light leaked from the combiner is shielded.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present application, the drawings required to be used in the embodiments or the background art of the present application will be described below.

Fig. 1 is a schematic structural diagram of an augmented reality device provided in an embodiment of the present application;

FIG. 2 is a schematic diagram of the augmented reality device shown in FIG. 1 being worn on the head of a user;

FIG. 3 is a simplified structural schematic of the structure shown in FIG. 2;

FIG. 4 is an enlarged schematic view of region A of the structure of FIG. 3 in one embodiment;

FIG. 5a is a schematic plan view of the coupling 31 in another embodiment of the structure shown in FIG. 4;

FIG. 5b is a schematic plan view of the coupling 31 in the third embodiment in the configuration shown in FIG. 4;

FIG. 5c is a schematic plan view of the coupling 31 in the fourth embodiment in the configuration shown in FIG. 4;

FIG. 6a is a schematic diagram of the tunable grating of the structure of FIG. 4 in a first state;

FIG. 6b is a schematic diagram of the tunable grating of FIG. 4 in a third state;

FIG. 7 is a schematic view of the optical path of the structure of FIG. 4 in one state;

FIG. 8 is a schematic optical path diagram of the structure of FIG. 4 in another state;

FIG. 9 is an enlarged view of region A of the structure of FIG. 3 in another embodiment;

FIG. 10a is a schematic view of the active shutter glasses in the fourth state in the structure of FIG. 9;

FIG. 10b is a schematic view of the active shutter glasses of the structure of FIG. 9 in a second state;

FIG. 11 is a schematic diagram of the operation of the tunable grating, image projector, and active shutter glasses of the augmented reality device of FIG. 9 during operation;

FIG. 12 is an enlarged view of region A of the structure of FIG. 3 in a third embodiment;

FIG. 13 is a schematic diagram of the structure of the active shutter glasses and the quarter-wave plate in the structure of FIG. 12;

FIG. 14 is an enlarged structural view of region A in the structure of FIG. 3 under a fourth embodiment;

FIG. 15 is an enlarged view of region A in the structure of FIG. 3, in accordance with a fifth embodiment;

fig. 16 is a schematic diagram of the operation of the tunable grating, the image projector, the active shutter glass, and the zoom in operation of the augmented reality device of fig. 15.

Detailed Description

The embodiments of the present application will be described below with reference to the drawings.

Referring to fig. 1, fig. 1 is a schematic structural diagram of an augmented reality device 100 according to an embodiment of the present disclosure.

The augmented reality device 100 may be an electronic product that combines digital content and a real scene, such as AR glasses, an AR helmet, mixed Reality (MR) glasses, or an MR helmet. The augmented reality device 100 of the embodiment shown in fig. 1 is illustrated by taking AR glasses as an example.

In this embodiment, the augmented reality device 100 includes a mirror frame 10 and an augmented reality assembly 30 mounted to the mirror frame 10. There are two augmented reality assemblies 30, and the two augmented reality assemblies 30 are mounted to the frame 10 at intervals.

The frame 10 includes a frame 11 and a temple 12 to which the frame 11 is attached. Wherein there are two temples 12, and the two temples 12 are connected to opposite ends of the frame 11. It should be noted that, in other embodiments, the frame 10 may also include a frame 11 and a fixing band connected to the frame 11, which is not specifically limited in this application.

The frame 11 includes two rims 13 and a bridge 14 connected between the two rims 13. Each of the frames 13 includes a first frame 131 away from the cross member 14 and a second frame 132 disposed opposite the first frame 131. An accommodating cavity (not shown) is formed inside the first frame 131, and the accommodating cavity of the first frame 131 is used for accommodating electronic components of the augmented reality device 100. The bridge 14 is integrally formed with the two rims 13 to simplify the molding process of the frame 11 and increase the overall strength of the frame 11. The material of the frame 11 includes, but is not limited to, metal, plastic, resin, natural material, or the like. It should be understood that the frame 11 is not limited to the full-frame type shown in fig. 1, but may be a half-frame type or a frameless type frame.

Two temples 12 are rotatably coupled to opposite ends of the frame 11. Specifically, the two temples 12 are rotatably connected to two rims 13 of the frame 11, respectively. The two temples 12 are connected to the first frames 131 of the two frames 13, respectively. When the augmented reality device 100 is in the unfolded state (as shown in fig. 1), the two temples 12 rotate to be opposite to each other through the opposite glasses frame 11, at this time, the two temples 12 of the augmented reality device 100 can be respectively erected on two ears of the user, and the cross beam 14 is erected on the nose bridge of the user so as to be worn on the head of the user. When the augmented reality device 100 is in the folded state, the two temples 12 are at least partially overlapped and accommodated inside the frame 11 by rotating with respect to the frame 11, and at this time, the augmented reality device 100 can be accommodated. It is understood that in other embodiments, the two temples 12 may be respectively fixedly connected to the first frames 131 of the two frames 13, or the two temples 12 may be integrally formed with the frame 11, that is, the augmented reality device 100 is always in the unfolded state, which is not particularly limited in this application. The inside of the temple 12 may be provided with a housing cavity, and the housing cavity of the temple 12 may house electronic components of the augmented reality device 100.

It should be noted that the terms "inside" and "outside" used in this application when referring to the augmented reality device 100 are mainly described according to the orientation of the augmented reality device 100 when being worn on the head of the user. When the augmented reality device 100 is worn by the user, the augmented reality device 100 is positioned close to the head of the user as an inner side and away from the head of the user as an outer side, which does not limit the orientation of the augmented reality device 100 in other scenes.

Please refer to fig. 2 and fig. 3. Fig. 2 is a schematic structural diagram of the augmented reality device 100 shown in fig. 1 worn on the head of a user. Fig. 3 is a simplified structural schematic of the structure shown in fig. 2.

Next, for convenience of description, as shown in fig. 2 and 3, a length direction of the augmented reality device 100 is defined as an X-axis direction, a width direction of the augmented reality device 100 is defined as a Y-axis direction, a thickness direction of the augmented reality device 100 is defined as a Z-axis direction, and the X-direction, the Y-direction, and the Z-direction are perpendicular to each other two by two. The X-axis direction is a direction from one frame 13 to the other frame 13 in the frame 11, and the Z-axis direction is a direction from the temple 12 to the frame 11.

In this embodiment, the two augmented reality components 30 have the same structure. Specifically, two augmented reality assemblies 30 are respectively mounted on two rims 13 of the frame 11. When the augmented reality device 100 is worn on the head of a user, one augmented reality component 30 corresponds to the left eye of the user, and the other augmented reality component 30 corresponds to the right eye of the user, and at this time, the two eyes of the user can watch a virtual scene and a real scene through the two augmented reality components 30. It should be noted that in other embodiments, the two augmented reality assemblies 30 may have different structures, and the present application is not limited to this.

Next, for ease of understanding, the structure of the augmented reality component 30 will be specifically described taking the augmented reality component 30 corresponding to the right eye of the user as an example.

Referring to fig. 3 and 4, fig. 4 is an enlarged schematic view of a region a in the structure shown in fig. 3 according to an embodiment.

Augmented reality component 30 includes combiner (combiner) 31, image projector 32, active shutter lens 33, and processor 34. Specifically, the coupler 31 is mounted to the frame 10. The combiner 31 includes a tunable grating 316. The active shutter lens 33 is mounted outside the coupler 31 and covers the tunable grating 316. The image projector 32 is mounted to the frame 10. The processor 34 is coupled to the tunable grating 316, the image projector 32, and the active shutter lens 33, and is configured to control the opening and closing of the image projector 32, and to adjust the working states of the tunable grating 316 and the active shutter lens 33.

It should be noted that, in other embodiments, the two augmented reality components 30 may include only one processor 34, and the processor 34 is coupled to the image projectors 32 of the two augmented reality components 30 at the same time to control the on and off of the two image projectors 32, which is not specifically limited in this application.

The coupler 31 is attached to the frame 11 of the frame 10. In this embodiment, the couplers 31 of the two enhanced display modules 30 are arranged side by side in the X-axis direction. Specifically, the couplers 31 of the two augmented reality modules 30 are mounted to the frame 11 at intervals. The coupling device 31 is attached to the rim 13 of the frame 11. The inner surface 312 of the coupling 31 is a surface of the coupling 31 facing the inner side of the frame 11. The outer surface 313 of the coupling 31 is a surface of the coupling 31 facing the outside of the frame 11. In this embodiment, the combiner 31 is a diffractive optical waveguide that combines digital content and a real scene using a diffractive optical waveguide technology.

Specifically, the coupler 31 further includes a substrate 314 and a coupling grating 315. The base 314 is mounted to the bezel 13. One end of the substrate 314 is mounted on the first frame 131 of the frame 13 and is received in the receiving cavity 133 of the first frame 131. The other end of the substrate 314 is mounted to the second frame 133 of the frame 13. The substrate 314 includes an inner surface (not shown) and an outer surface (not shown) that are disposed opposite one another. The inner surface of the base 314 is a surface of the base 314 facing the inner side of the frame 11. The outer surface of the base 314 is the surface of the base 314 facing the outside of the frame 11.

In one embodiment, tunable grating 316 may comprise an out-coupling grating. The incoupling grating 315 and the tunable grating 316 are both reflective gratings. Specifically, the incoupling grating 315 is mounted on the outer surface of the substrate 314 and located in the receiving cavity 133 of the first frame 131. Tunable grating 316 is coupled to processor 34. The tunable grating 316 is mounted on the outer surface of the substrate 314, spaced apart from the incoupling grating 315, and located between the first frame 131 and the second frame 133.

In other embodiments, the in-coupling grating 315 and the tunable grating 316 can also be transmissive gratings, in which case the in-coupling grating 315 and the tunable grating 316 are mounted on the inner surface of the substrate 314. In addition, the incoupling grating 315 and the tunable grating 316 may also be a holographic grating, a tilted grating, a polarization grating, a liquid crystal grating, a holographic optical element, or a diffractive optical element, which is not particularly limited in this application.

It should be understood that a grating refers to an optical device that consists of a large number of parallel slits of equal width and equal spacing. When light is incident on the grating surface at a certain angle, the grating can perform spatial periodic adjustment on the amplitude or phase of the light, so that the light can be emitted out of the grating surface from a direction different from the incident angle. The description of the grating is understood the same hereinafter.

Referring to fig. 5a, fig. 5a is a schematic plan view of the coupling 31 shown in fig. 4 according to another embodiment.

In this embodiment, the tunable grating 316 may include an outcoupling grating 3161 and a pupil expanding grating 3162, and the incoupling grating 315, the outcoupling grating 3161, and the pupil expanding grating 3162 are all reflective gratings and are all mounted on the outer surface of the substrate 314. Specifically, the pupil expanding grating 3162 is located below the incoupling grating 315 and is opposite to the incoupling grating 3161. The pupil expanding grating 3162 is used to expand the light coupled into the substrate 314 by the in-coupling grating 315, and then transmit the light to the out-coupling grating 3161, so as to improve the uniformity of the light. In other embodiments, the tunable grating 316 may also include all other gratings in the diffractive optical waveguide except the in-coupling grating 315.

It should be noted that the terms "lower side" and the like used in this application to refer to the pupil grating 3162 are mainly explained according to the orientation of the coupling grating 315, and do not form a limitation on the orientation of the augmented reality device 100 in other scenarios, and the following description of the orientation of the pupil grating 3162 can be understood in the same way.

Referring to fig. 5b, fig. 5b is a schematic plan view of the coupler 31 shown in fig. 4 according to a third embodiment.

In this embodiment, the tunable grating 316 may include an outcoupling grating 3161 and a pupil expanding grating 3162, and the incoupling grating 315, the outcoupling grating 3161, and the pupil expanding grating 3162 are all reflective gratings and are all mounted on the outer surface of the substrate 314. Specifically, the pupil expanding grating 3162 is located on the right side of the in-coupling grating 315, and is disposed opposite to the out-coupling grating 316.

Referring to FIG. 5c, in addition, fig. 5c is a schematic plan view of the coupling 31 shown in fig. 4 according to a fourth embodiment.

In this embodiment, the tunable grating 316 may include an outcoupling grating 3161 and a pupil expanding grating 3162, and the incoupling grating 315, the outcoupling grating 3161, and the pupil expanding grating 3162 are all reflective gratings and are all mounted on the outer surface of the substrate 314. Two of the pupil expansion gratings 3162 are provided. Specifically, one pupil expansion grating 3162 is located on the right side of the incoupling grating 315, the other pupil expansion grating 3162 is located on the left side of the incoupling grating 315, and both pupil expansion gratings 3162 are disposed opposite to the incoupling grating 3161.

Referring to fig. 6a and 6b, fig. 6a is a schematic structural diagram of the tunable grating 316 in the structure shown in fig. 4 in a first state, and fig. 6b is a schematic structural diagram of the tunable grating 316 in the structure shown in fig. 4 in a third state.

In this embodiment, the tunable grating 316 may be a grating made of liquid crystal and photopolymer. The photopolymer includes, but is not limited to, acrylamide-based and polyvinyl alcohol-based photopolymers, acrylate-based photopolymers, thiol-hydrocarbon-based photopolymers, or nanoparticle-doped photopolymers. Specifically, the tunable grating 316 has two operating states, which are the first state and the third state, respectively, and the processor 34 is configured to adjust the operating state of the tunable grating 316.

When processor 34 (shown in fig. 4) powers up tunable grating 316, tunable grating 316 is in a first state, and tunable grating 316 is a diffraction grating capable of diffracting light. At this time, the tunable grating 316 has a different refractive index between the liquid crystal and the polymer, and the liquid crystal and the polymer are periodically arranged, so that the tunable grating 316 behaves as a diffraction grating. The tunable grating 316 includes a plurality of liquid crystal clusters, each of which is formed by analyzing a plurality of liquid crystals. Each liquid crystal group is uniformly arranged at an angle, and the distance between every two adjacent liquid crystal groups is a period. In the present application, the angle of the liquid crystal clusters is not particularly limited, and the liquid crystal clusters may be uniformly arranged at any angle.

When the processor 34 powers off the tunable grating 316, the tunable grating 316 is in the third state, and the tunable grating 316 is a transparent flat plate and does not diffract light. At this time, the refractive index of the liquid crystal and the polymer in the tunable grating 316 are the same, and the tunable grating 316 is a parallel flat plate with uniform whole. Where the outer and inner surfaces of the tunable grating 316 are parallel (allowing for some deviation).

In other embodiments, when the processor 34 powers on the tunable grating 316, the tunable grating 316 is in the off state, the tunable grating 316 is a transparent flat plate and does not diffract light, and when the processor 34 powers off the tunable grating 316, the tunable grating 316 is in the on state, and the tunable grating 316 is a diffraction grating and diffracts light.

Referring to fig. 4, coupler 31 includes an inner surface 312 and an outer surface 313 that are oppositely disposed. In this embodiment, the inner surface 312 of the coupler 31 is the inner surface of the substrate 314. The inner surface 312 of the coupler 31 includes a light entrance region 3121 and a light exit region 3122. The light incident area 3121 of the inner surface 312 is located in the accommodating cavity 133 of the first frame 131. Specifically, the light incident region 3121 of the inner surface 312 is the region covered by the projection of the incoupling grating 315 on the inner surface 312. That is, the region of the inner surface 312 of the coupler 31 facing the incoupling grating 315 is the light entrance region 3121 of the inner surface 312.

The light exiting region 3122 of the inner surface 312 is spaced apart from the light entering region 3121, and is located between the first bezel 131 and the second bezel 132. Specifically, the light exit region 3122 of the inner surface 312 is the region covered by the projection of the tunable grating 316 onto the inner surface 312. That is, the region of the inner surface 312 directly opposite the tunable grating 316 is the light exit region 3122 of the inner surface 3123.

The outer surface 313 of the combiner 31 includes a surface of the incoupling grating 315 facing away from the substrate 314, a surface of the tunable grating 316 facing away from the substrate 314, and areas of the outer surface of the substrate 314 not covered by the incoupling grating 315 and the tunable grating 316. That is, the outer surface 313 of the combiner 31 includes the outer surface of the incoupling grating 315, the outer surface of the tunable grating 316, and the area of the outer surface of the substrate 314 not covered by the incoupling grating 315 and the tunable grating 316. Wherein the outer surface 313 of the coupling 31 comprises a functional area 3131. In particular, the functional region 3131 of the outer surface 313 is the surface of the tunable grating 316 facing away from the substrate 314, i.e. the outer surface of the tunable grating 316.

In this embodiment, the image projector 32 is located in the accommodating cavity 133 of the first frame 131 and is disposed opposite to the connector 31. In particular, image projector 32 is located on a side of substrate 314 facing away from incoupling grating 315. That is, image projector 32 and incoupling grating 315 are located on opposite sides of substrate 314, respectively. Where the image projector 32 is directly opposite the light entry region 3121 of the interior surface 312. It will be appreciated that when incoupling grating 315 is a transmissive grating, image projector 32 and incoupling grating 315 are on the same side of substrate 314. In other embodiments, the image projector 32 may be located in the accommodating cavity of the temple 12 (i.e., inside the temple 12), or the image projector 32 may be located partially in the accommodating cavity 133 of the first frame 131 and partially in the accommodating cavity of the temple 12, or the image projector 32 may be exposed directly to the surface of the frame 13 without being located in the accommodating cavity 133 of the first frame 131 or the accommodating cavity of the temple 12, as long as the view of the user is not obstructed when the augmented reality device 100 is used.

The image projector 32 includes, but is not limited to, liquid Crystal On Silicon (LCOS), digital Light Processing (DLP), light Emitting Diode (LED), organic Light Emitting Diode (OLED), quantum dot light emitting diode (QLED), active-matrix organic light emitting diode (AMOLED), flexible light emitting diode (flex-emitting diode, FLED), mini LED, micro OLED, micro LED, or Laser Micro electro mechanical system (Laser MEMS).

Referring to fig. 7, fig. 7 is a schematic optical path diagram of the structure shown in fig. 4 in one state.

Processor 34 turns on image projector 32 and adjusts tunable grating 316When the tunable grating 316 is in the first state and the image projector 32 is in the on state, the image projector 32 projects the display light L to the combiner 31 ₀ Display light L ₀ Diffracted light is generated by diffraction in the tunable grating 316, and part of the diffracted light is emitted to the inside of the coupler 31 and part of the diffracted light (shown as L) ₂ ) Towards the outside of the coupling 31. Wherein image projector 32 projects display light L carrying digital content ₀ . It can be understood that the diffracted light L ₁ And graphic representation L ₂ As well as both light carrying digital content.

Specifically, the display light L ₀ The light is emitted (for example, in fig. 7, in the case of normal incidence) to the inner surface of the substrate 314 (i.e., the inner surface 312 of the coupler 31), perpendicularly emitted from the light incident region 3121 of the inner surface 312 to the incoupling grating 315, and coupled into the substrate 314 through the incoupling grating 315. Wherein the incoupling grating 315 already transmits the display light L ₀ Is adjusted to a state satisfying the total reflection condition. Display light L ₀ At least one total reflection occurs within the substrate 314 and propagates in the direction of the tunable grating 316 until it reaches the tunable grating 316. Since the tunable grating 316 is in the on state, the display light L ₀ Will be diffracted by the tunable grating 316 to form diffracted light. Part of the diffracted light is emitted from the light-emitting area 3122 of the inner surface 312 to the inside of the coupler 31, i.e. towards the human eye, and is indicated as eye-entering light L ₁ Incident on light ray L ₁ Imaging can be performed into the human eye to enable the user to see a virtual scene carrying digital content. At the same time, part of the diffracted light, which is labeled as leakage light L in fig. 7, is emitted from the functional region 3131 of the outer surface 313 to the outside of the coupling 31 ₂ 。

When the processor 34 turns off and turns on the image projector 32, and the tunable grating 316 is adjusted to the third state, that is, when the tunable grating 316 is in the third state and the image projector 32 is in the on state, the image projector 32 projects the display light L to the combiner 31 ₀ Display light L ₀ Exiting from the outer surface 313 of the coupler 31. Specifically, the display light L ₀ Vertical beamToward the inner surface of base 314 (i.e. inner surface 312 of coupler 31), the light incident region 3121 from the inner surface 312 is directed perpendicularly toward the incoupling grating 315 and coupled into the substrate 314 via the incoupling grating 315. Display light L ₀ At least one total reflection occurs within the substrate 314 and propagates in the direction of the tunable grating 316 until it reaches the tunable grating 316.

When processor 34 turns off image projector 32 (when processor 34 may turn on or off tunable grating 316), that is, when image projector 32 is in the off state (when tunable grating 316 may be in the first state or in the third state), image projector 32 does not project display light L ₀ At this time, there is no in-eye light L ₁ Enters human eyes for imaging and does not leak light L ₂ Propagating to the outside of the coupler 31.

Referring to fig. 4, the active shutter lens 33 is located on a side of the coupler 31 away from the image projector 32, that is, the active shutter lens 33 and the image projector 32 are located on opposite sides of the coupler 31. In this embodiment, the active shutter glasses 33 are glasses based on electrochromic materials (except for liquid crystal). It will be appreciated that the active shutter lens 33 is a lens that can be rapidly switched on and off under the control of the processor 34. Specifically, the active shutter glasses 33 have two working states, which are the second state and the fourth state, respectively, and the processor 34 is configured to adjust the working states of the active shutter glasses 33.

When the processor 34 opens the active shutter lens 33, that is, when the active shutter lens 33 is in the fourth state, the transmittance of the active shutter lens 33 is higher (the transmittance is greater than 40%), and the light can normally propagate through the active shutter lens 33. When the processor 34 closes the active shutter lens 33, that is, when the active shutter lens 33 is in the second state, the transmittance of the active shutter lens 33 is low (the transmittance is close to 0), the active shutter lens 33 blocks light, that is, the light cannot pass through the active shutter lens 33, that is, the active shutter lens 33 can absorb the light.

In this embodiment, two ends of the active shutter lens 33 may be respectively mounted on the outer surface 313 of the connector 31 by a sealant. Between the middle portion of the active shutter lens 33 and the outer surface 313 of the coupler 31In the air gap to ensure the display light L ₀ Total reflection can occur in the diffractive light waveguide. The width d of the air gap is about 50 μm. It should be understood that, since the thicknesses of the incoupling grating 315 and the tunable grating 316 are in the nanometer level, the active shutter lens 33 does not contact the incoupling grating 315 and the tunable grating 316.

The active shutter lens 33 covers the coupler 31. Specifically, the active shutter lens 33 covers the outer surface 313 of the coupler 31 to ensure the integrity and consistency of the appearance of the augmented reality device 100 and improve the aesthetic appearance of the augmented reality device 100. That is, the active shutter lens 33 covers the outer surface of the incoupling grating 315, the outer surface of the tunable grating 316, and the portion of the outer surface of the substrate 314 not covered by the incoupling grating 315 and the tunable grating 316. At this time, the active shutter lens 33 may serve as a protective glass to protect the incoupling grating 315 and the tunable grating 316.

It should be noted that in other embodiments, the active shutter lens 33 may cover only the functional area 3131 of the outer surface 313, that is, the active shutter lens 33 may cover only the outer surface of the tunable grating 316. It can be understood that, compared with the active shutter lens 33 covering only the functional area 3131 of the outer surface 313, the active shutter lens 33 covering the outer surface 313 of the coupler 31 not only reduces the difficulty of the assembly process of the active shutter lens 33, but also does not need to additionally process the active shutter lens 33, reduces the difficulty of processing the active shutter lens 33, and reduces the production cost of the active shutter lens 33.

In this embodiment, the processor 34 is located in the receiving cavity 133 of the first frame 131, and is electrically connected to the tunable grating 316, the image projector 32, and the active shutter lens 33. Processor 34 may include one or more processing units, among others. The plurality of processing units may be, for example, an Application Processor (AP), a modem processor, a Graphics Processor (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processor (NPU), etc. Wherein, the different processing units may be independent devices or may be integrated in one or more processors. It should be understood that the processor 34 may be a Central Processing Unit (CPU) of the augmented reality device 100, or may be another processor of the augmented reality device 100.

Processor 34 is configured to alternate between performing the first operation and the second operation. Specifically, the processor 34 controls the synchronous control of the opening and closing of the image projector 32, and adjusts the working states of the tunable grating 316 and the active shutter lens 33. That is, the processor 34 can simultaneously control the turning on and off of the image projector 32 and simultaneously control the operating state of the active shutter lens 33 when adjusting the operating state of the tunable grating 316. That is, processor 34 synchronously switches the operating states of tunable grating 316, image projector 32, and active shutter lens 33.

Referring to fig. 7, when the processor 34 executes the first operation, the processor 34 turns on the image projector 32, adjusts the tunable grating 316 to the first state, and adjusts the active shutter lens 33 to the second state, i.e., the tunable grating 316 is in the first state, the image projector 32 is in the open state, and when the active shutter lens 33 is in the second state, the active shutter lens 33 blocks the display light L emitted from the outer surface 313 of the combiner 31 ₀ And ambient light L directed toward the outer surface 313 of the coupler 31 _C 。

Specifically, the display light L projected by the image projector 32 ₀ After entering the combiner 31 from the light entrance region 3121 of the inner surface 312, the incident light L ₁ The light emergent region 3121 of the inner surface 312 is irradiated into human eye for imaging, and the leakage light L ₂ From the functional area 3131 of the outer surface 313 towards the active shutter lens 33. Since the active shutter lens 33 is in the closed state at this time, the transmittance of the active shutter lens 33 is close to 0, and the active shutter lens 33 will leak the light L ₂ Shielding, i.e. absorption of leakage light L by the active shutter lens 33 ₂ Preventing leakage light L from the outer surface 313 of the coupler 31 ₂ Penetrate through the active shutter lens 33 and enter the external environment to avoid the leakage light L carrying the digital content ₂ Is leaked outNot only can the privacy of the user and the sociability of the augmented reality device 100 be improved, but also the leakage light L that is leaked out can be avoided ₂ A small display window is formed on the surface of the augmented reality device 100, the aesthetic appearance of the user when using the augmented reality device 100 is improved.

At this time, the ambient light Lc is emitted from the outside to the active shutter lens 33. Because the active shutter lens 33 is in the closed state, the light transmittance of the active shutter lens 33 is close to 0, and the active shutter lens 33 completely blocks the ambient light Lc, which is equivalent to the active shutter lens 33 absorbing the ambient light Lc, so as to prevent the ambient light Lc from being incident into the tunable grating 316 to generate diffraction, thereby preventing human eyes from seeing light with various colors, effectively avoiding the occurrence of rainbow effect, and improving the use experience of a user when using the enhanced display device 100.

Referring to fig. 8, fig. 8 is a schematic optical path diagram of the structure shown in fig. 4 in another state.

When the processor 34 executes the second operation, the processor 34 turns off the image projector 32, adjusts the tunable grating 316 to the first state, and adjusts the active shutter 33 to the second state, that is, when the image projector 32 is in the off state, the tunable grating 316 is in the first state, and the active shutter 33 is in the second state, the ambient light Lc can enter the coupler 31 from the outer surface 313 of the coupler 31 through the active shutter 33, and exit through the inner surface 312 of the coupler 31. Since the active shutter lens 33 is in the open state at this time, the transmittance of the active shutter lens 33 is high, and the ambient light Lc can enter the combiner 31 from the outer surface of the tunable grating 316 through the active shutter lens 33. With the tunable grating 316 in the off state, ambient light Lc can directly pass through the tunable grating 316 from the inner surface 312 of the coupler 31 toward the human eye, and thus enter the human eye for imaging. That is, the human eye can view the external real scene through the active shutter lens 33 and the coupler 31. In addition, because image projector 32 is turned off, image projector 32 does not project display light L carrying digital content ₀ No incident light L ₁ Is injected into human eyes, and does not leak light L ₂ Draining from augmented reality device 100Exposing the solution. That is, the human eye can only see the real scene of the outside world.

In one embodiment, processor 34 includes a control unit and a memory unit. The control unit is used to control the opening and closing of the image projector 32 and the active shutter lens 33. The storage unit is used for storing a preset frequency f ₀ At a predetermined frequency f ₀ Equal to or greater than 60Hz. Specifically, when the augmented reality device 100 is turned on, the image projector 32 and the active shutter lens 33 are in different states in the first period and the second period, respectively. During a first time period, processor 34 performs a first operation, with tunable grating 316 and image projector 32 in an open state and active shutter lens 33 in a closed state. During a second time period, processor 34 performs a second operation, with tunable grating 316 and image projector 32 in the closed state and active shutter lens 33 in the open state.

Wherein the first time interval and the second time interval form a cycle T,1/T = f ₀ . That is, T is less than or equal to 1/60 second. That is, when the augmented reality device 100 is turned on, 1 second includes at least 60 cycles, i.e., the first period and the second period occur at least 60 times within 1 second. That is, the frequency of alternation of image projector 32 between the on and off states is greater than 120Hz. The frequency of alternation of the active shutter glasses 33 between the closed and open state is larger than 120Hz.

It should be understood that the flicker frequency (also called human eye refresh frequency) perceivable to the human eye is 60Hz. Since the preset switching frequency is greater than the human eye refresh frequency, the display light L projected by the image projector 32 is generated according to a persistence of vision (also called a pause of vision or an afterglow effect) when the augmented reality device 100 is in operation ₀ The light enters human eyes, and the ambient light Lc enters the human eyes, namely, the human eyes can see both a virtual scene and an external real scene. Moreover, not only is the rainbow effect eliminated, but the display light projected from the image projector 32 does not leak out of the augmented reality device 100. That is to say, the augmented reality device 100 shown in this embodiment can greatly alleviate the rainbow effect and improve the transmittance of the augmented reality device 100 on the premise of ensuring the transmittance of the augmented reality device 100The user experiences when using the augmented reality device 100, and the display light leaked from the combiner 31 is shielded, so that the privacy and the sociability of the augmented reality device 100 are improved, and the appearance elegance of the user when using the augmented reality device 100 is improved.

Referring to fig. 9, fig. 9 is an enlarged view of a region a in the structure shown in fig. 3 according to another embodiment.

The augmented display components of the augmented display device include a combiner 31, an image projector 32, an active shutter lens 33, and a processor 34. The coupler 31 is mounted to the frame 10. An active shutter lens 33 is mounted to an outer surface of coupler 31, an image projector 32 is mounted to frame 10, and a processor 34 couples coupler 31, image projector 32, and active shutter lens 33.

The augmented reality device shown in the present embodiment is different from the augmented reality device 100 shown in the above embodiment in that the active shutter glasses 33 are liquid crystal light valves. The active shutter lens 33 includes a liquid crystal cell 331, a first polarizer 332, and a second polarizer 333. Liquid crystal cell 331 is coupled to processor 34. The first polarizer 332 is located on the side of the liquid crystal cell 331 facing away from the coupler 31, and the first polarizer 332 covers the surface of the liquid crystal cell 331 facing away from the coupler 31. That is, the first polarizer 332 covers the outer surfaces of the liquid crystals and 331. The second polarizer 333 is positioned between the liquid crystal cell 331 and the coupler 31. I.e. the second polarizer 333 is located on the side of the liquid crystal cell 331 facing away from the first polarizer 332, i.e. the second polarizer 333 is located on the side of the liquid crystal cell 331 facing the combiner 31. In addition, the second polarizer 333 covers the inner surface of the liquid crystal cell 331. I.e. the second polarizer 333 covers the surface of the liquid crystal cell 331 facing the combiner 31. The first polarizer 332 is perpendicular to the transmission axis of the second polarizer 333. That is, the polarization direction of the light exiting through the first polarizer 332 and the polarization direction of the light exiting through the second polarizer 333 are perpendicular to each other.

The liquid crystal light valve is an optical device that realizes phase retardation of light by voltage-controlling the refractive index of liquid crystal molecules. The liquid crystal cell 331 is used to generate a phase retardation for light according to the operating principle of liquid crystal molecules. The first polarizer 332 serves to change the polarization state of the incident light incident to the outer surface of the liquid crystal cell 331, and to convert the incident light into linearly polarized light, so that the incident light is directed to the outer surface 313 of the coupler 31 through the liquid crystal cell 331 and the second polarizer 333.

Referring to fig. 10a and 10b together, fig. 10a is a schematic structural view of the active shutter lens 33 in the fourth state in the structure shown in fig. 9, and fig. 10b is a schematic structural view of the active shutter lens 33 in the second state in the structure shown in fig. 9. It should be noted that, in the drawings of the present application, a straight line with arrows at both ends shown in a circle on the left side in the drawing represents the polarization state of a light ray at the position, and the description of the drawing can be understood in the following.

In one embodiment, the active shutter glasses 33 are TN type liquid crystal light valves.

When the processor 34 turns on the active shutter lens 33, that is, when the active shutter lens 33 is in the fourth state, the liquid crystal light valve is in the power-off state, that is, the voltage difference between two sides of the liquid crystal layer in the liquid crystal cell 331 is zero. The ambient light Lc enters the liquid crystal cell 331 after being filtered by the first polarizer 332, liquid crystal molecules in the liquid crystal cell 331 are spiral at this time, the liquid crystal cell 331 retards the phase of the light emitted from the first polarizer 332 by pi, and the light emitted from the liquid crystal cell 331 can pass through the second polarizer 333 and be emitted to the outer surface 313 of the combiner 31 because the second polarizer 333 is perpendicular to the transmission axis direction of the first polarizer 332. That is, the ambient light Lc can pass through the active shutter lens 33 and is emitted into human eyes from the inner surface 312 of the coupler 31 for imaging, so as to ensure that the user can observe the real scene of the outside. At this time, the natural light transmittance of the active shutter lens 33 is between 35% and 50%.

When the processor 34 closes the active shutter lens 33, that is, when the active shutter lens 33 is in the second state, the liquid crystal light valve is in the power-on state, that is, there is a voltage difference between two sides of the liquid crystal layer in the liquid crystal cell 331, and the liquid crystal in the liquid crystal layer rotates to be perpendicular to the first polarizer 33. Ambient light L _C The filtered light enters the liquid crystal cell 331 through the first polarizer 332, and the liquid crystal molecules in the liquid crystal cell 331 are vertical, so that the phase of the light emitted from the first polarizer 332 is not changed by the liquid crystal cell 331, because the transmission axes of the second polarizer 333 and the first polarizer 332 are squareThe light exiting through the liquid crystal cell 331 is not transmitted through the second polarizer 333 to the outer surface 313 of the coupler 31 and is completely blocked by the second polarizer 333. I.e. ambient light L _C Cannot pass through the active shutter lens 33. That is, the active shutter lens 33 emits the ambient light L _C Can be completely absorbed.

In another embodiment, the active shutter glasses 33 are IPS mode liquid crystal light valves.

When the augmented reality device 100 shown in this embodiment is worn on the head of a user and the processor 34 opens the active shutter lens 33, that is, the active shutter lens 33 is in the fourth state, the liquid crystal light valve is in the power-on state at this time, and a voltage difference exists between two sides of the liquid crystal layer in the liquid crystal cell 331. Ambient light L _C After being filtered by the first polarizer 332, the filtered light enters the liquid crystal cell 332, liquid crystal molecules in the liquid crystal cell 331 are in a spiral shape, and the liquid crystal cell 331 retards pi the phase of the light emitted by the first polarizer 332, which is equivalent to that the liquid crystal cell 331 rotates the polarization direction of the light emitted by the first polarizer 332 by 90 degrees. Since the second polarizer 333 is perpendicular to the transmission axis direction of the first polarizer 332, the light exiting through the liquid crystal cell 331 may pass through the second polarizer 333 toward the outer surface 313 of the coupler 31. That is, the ambient light Lc can pass through the active shutter lens 33 and is emitted into human eyes from the inner surface 312 of the coupler 31 for imaging, so as to ensure that the user can observe the real scene of the outside.

When the processor 34 closes the active shutter glasses 33, that is, the active shutter glasses 33 are in the second state, the liquid crystal light valve is in the power-off state, and the voltage difference between the two sides of the liquid crystal layer in the liquid crystal cell 331 is zero. Ambient light L _C After being filtered by the first polarizer 332, the filtered light enters the liquid crystal cell 331, and the liquid crystal cell 331 does not change the phase of the light emitted through the first polarizer 332. Since the second polarizer 333 is perpendicular to the transmission axis direction of the first polarizer 332, the light exiting through the liquid crystal cell 331 cannot pass through the second polarizer 333 toward the outer surface 313 of the combiner 31, and is completely blocked by the second polarizer 333. I.e. ambient light L _C Cannot pass through the active shutter lens 33. That is, the active shutter lens 33 emits the ambient light L _C And (4) completely absorbing.

It should be understood that in other embodiments, the active shutter glasses 33 may also be VA-type liquid crystal light valves, super twisted nematic-type liquid crystal light valves, or FLC-type liquid crystal light valves.

Next, for ease of understanding, the operation states of the tunable grating 316, the image projector 32, and the active shutter glass 33 in each period when the augmented reality device 100 shown in the present embodiment is in operation will be exemplified. Wherein, in the range of 0-t ₁₂ The time period is described as an example. 0-t ₁₂ The time period includes 12 time periods of duration Δ t. I.e. t _n -t _n-1 N is an integer of 1 to 12 inclusive.

Referring to fig. 11, fig. 11 is a schematic diagram illustrating an operation state of the tunable grating 316, the image projector 32, and the active shutter lens 33 when the augmented reality apparatus 100 shown in fig. 9 is in operation.

In this embodiment, the augmented reality device 100 operates at 0-t ₁ 、t ₂ -t ₃ 、t ₄ -t ₅ 、t ₆ -t ₇ 、t ₈ -t ₉ And t ₁₀ -t ₁₁ During the time period, the processor 34 executes the first operation, the processor 34 turns on the image projector 32, adjusts the tunable grating 316 to the first state, and adjusts the active shutter lens 33 to the second state, so as to eliminate the rainbow effect and ensure that the display light projected by the image projector 32 does not leak from the augmented reality device 100. At t ₁ -t ₂ 、t ₃ -t ₄ 、t ₅ -t ₆ 、t ₇ -t ₈ 、t ₉ -t ₁₀ And t ₁₁ -t ₁₂ During the time period, the processor 34 executes the second operation, the processor 34 turns off the image projector 32, adjusts the tunable grating 316 to the third state, and adjusts the active shutter lens 33 to the fourth state, so that the human eye can see the external real scene through the active shutter lens 33 and the combiner 31. In other words, 0-t ₁ 、t ₂ -t ₃ 、t ₄ -t ₅ 、t ₆ -t ₇ 、t ₈ -t ₉ And t ₁₀ -t ₁₁ The time periods are the first time periods, t, mentioned above ₁ -t ₂ 、t ₃ -t ₄ 、t ₅ -t ₆ 、t ₇ -t ₈ 、t ₉ -t ₁₀ And t ₁₁ -t ₁₂ The time periods are the second periods mentioned above. 0-t ₂ 、t ₂ -t ₄ 、t ₄ -t ₆ 、t ₆ -t ₈ 、t ₈ -t ₁₀ And t ₁₀ -t ₁₂ The time periods are each one cycle T mentioned above, and T =2 Δ T.

At this time, at 0-t ₁₂ In the time period, the total time length of the image projector 32 in the open state (i.e., the state in which the active shutter lens 33 is closed) is 6 Δ t, and the time length ratio is 50%. The total time length of the image projector 32 in the off state (i.e., the state in which the active shutter lens 33 is opened) is 6 Δ t, and the time length ratio is 50%. That is, the transmittance of the augmented reality device 100 is between 17.5% and 25%.

It is understood that, in the augmented reality device 100 shown in the embodiment, the transmittance of the augmented reality device 100 can be adjusted by adjusting the time ratio of the image projector 32 in the on and off states, that is, the time ratio of the tunable optical grating 316 in the first state and the third state, that is, the active shutter lens 33 in the second state and the fourth state. For example, when the duration of the image projector 32 in the on state is 20% of the duration of the whole period, that is, the duration of the image projector 32 in the off state is 80% of the duration of the whole period, the transmittance of the augmented reality device 100 is reduced by 20%, that is, the transmittance of the augmented reality device 100 is between 28% and 40%, that is, on the premise of ensuring the transmittance of the augmented reality device 100, the rainbow effect is eliminated, and the leakage light L of the combiner 31 is shielded ₂ 。

It should be noted that, in practical applications, since the response time (millisecond level) of the liquid crystal light valve closing is far longer than the response time (microsecond level or nanosecond level) of the image projector 32 opening, in order to ensure that the active shutter lens 33 can effectively and timely block the leakage light L ₂ The point in time that the active shutter lens 33 is adjusted to the second state should be no later than the point in time that the tunable grating 316 is adjusted to the first state and the image projector 32 is turned on. I.e. masterThe time point when the active shutter lens 33 is adjusted to the second state should be earlier than the time point when the tunable grating 316 is switched to the first state and the image projector 32 is turned on, or the time point when the active shutter lens 33 is adjusted to the second state should be the same as the time point when the tunable grating 316 is adjusted to the first state and the image projector 32 is turned on. Suppose the response time of the liquid crystal light valve is t _r Then, the time point when the active shutter lens 33 is adjusted to the second state needs to be earlier than the time point when the image projector 32 is turned on by t _r 。

In this embodiment, the response time of the liquid crystal light valve is about 1ms to 2ms, that is, the active shutter lens 33 can be closed 1ms to 2ms before the tunable grating 316 is adjusted to the first state and the image projector 32 is turned on, so as to ensure that the active shutter lens 33 can completely block the leakage light L in time ₂ 。

Referring to fig. 12, fig. 12 is an enlarged structural view of a region a in the structure shown in fig. 3 according to a third embodiment.

The augmented reality device of this embodiment differs from the augmented reality device 100 of the second embodiment in that the augmented reality device 100 further includes a quarter-wave plate 40 (also called a quarter-wave retardation plate), and the quarter-wave plate 40 covers a surface of the first polarizer 332 facing away from the liquid crystal cell 331, i.e. the quarter-wave plate 40 covers an outer surface of the first polarizer 332. Wherein the quarter-wave plate is a birefringent single crystal wave plate with a certain thickness. When light passes through the quarter-wave plate from the incident light, birefringence occurs to divide the light into ordinary light and extraordinary light, the ordinary light being light that complies with the law of refraction, the extraordinary light being light that does not comply with the law of refraction, and the phase difference between the ordinary light and the extraordinary light being equal to pi/2 or an odd multiple thereof. In this embodiment, the quarter-wave plate 40 is an achromatic quarter-wave plate, that is, the phase retardation of the quarter-wave plate to light in the visible light band is pi/2, so as to ensure that visible light in the ambient light can enter human eyes for imaging.

Referring to fig. 13, fig. 13 is a schematic structural diagram of the active shutter lens 33 and the quarter-wave plate 40 in the structure shown in fig. 12.

In this embodiment, the included angle between the fast axis direction of the quarter-wave plate 40 and the transmission axis direction of the first polarizer 332 is 45 degrees. That is, the fast axis of the quarter-wave plate 40 is set at an angle of 45 degrees to the polarization direction of linearly polarized light that can be transmitted through the first polarizer 332. It should be understood that, since many electronic screens commonly used in life are Liquid Crystal Displays (LCDs), light emitted from the LCDs is linearly polarized light. When the augmented reality device 100 shown in this embodiment is worn on the head of a user, and the electronic screen is viewed through the augmented reality device 100, and the line of sight rotates around the electronic screen, no matter whether the polarization state of the emergent light of the electronic screen is perpendicular or parallel to the direction of the light transmission axis of the polarizer 332, the quarter-wave plate 40 will change the linearly polarized light emitted by the electronic screen into circularly polarized light, and attenuate the emergent light of the electronic screen by 50%. When the processor starts the active shutter lens 33, the first polarizer 332 transforms the circularly polarized light into a linearly polarized light, enters the liquid crystal cell 331, and enters human eyes through the liquid crystal cell 331 and the combiner 31, so that the brightness difference existing when a user watches an electronic screen is reduced, and the use feeling of the user wearing the augmented reality device 100 when the user watches the electronic screen is improved.

That is to say, when the augmented reality device 100 shown in this embodiment is worn on the head of the user, the electronic screen of the surrounding environment can be viewed only by opening the active shutter lens 33 without taking off the augmented reality device 100, so that the convenience in use of the augmented reality device 100 is improved.

In this embodiment, the active shutter glasses 33 of the two augmented reality components 30 each include a liquid crystal cell 331, a first polarizer 332, and a second polarizer 333. The liquid crystal cell 331 is coupled to the processor 34, and the first polarizer 332 covers the outer surface of the liquid crystal cell 331 and the second polarizer 333 covers the inner surface of the liquid crystal cell 331. When the processor 34 opens the active shutter lens 33, the ambient light Lc filtered by the first polarizer 332 may sequentially pass through the liquid crystal cell 331 and the second polarizer 333 to the outer surface 313 of the coupler 31 and then to the human eye from the inner surface 312 of the coupler 31, so that both the left eye and the right eye of the user can view the real environment of the outside through the active shutter lens 33 and the coupler 31.

Specifically, there are two quarter wave plates 40. A quarter-wave plate 40 covers the outer surface of a first polarizer 332, and the angle between the fast axis direction and the transmission axis direction of the first polarizer 332 is 45 degrees. The other quarter-wave plate 40 covers the outer surface of the other first polarizer 332, and the fast axis direction thereof forms an angle of 45 degrees with the polarization direction of the first polarizer 332. That is to say, an included angle between the fast axis direction of each quarter-wave plate 40 and the transmission axis direction of the first polarizer 332 covered by the quarter-wave plate is 45 degrees, so as to ensure that when the user wears the augmented reality device 100 to watch the electronic screen and the lines of sight of the two eyes rotate around the electronic screen, the brightness difference of the electronic screen watched by the two eyes is small, and the comfort level of the user wearing the augmented reality device 100 to watch the electronic screen is improved.

The transmission axes of the two first polarizers 332 are the same, the included angle between the fast axes of the two quarter-wave plates 40 is 90 degrees, or the included angle between the transmission axes of the two first polarizers 332 is 90 degrees, and the fast axes of the two quarter-wave plates 40 are the same, so as to ensure that the two augmented reality components 30 respectively pass through polarized lights with polarization directions perpendicular to each other, such as a left-handed polarized light and a right-handed polarized light, so that the augmented reality device 100 can also be used in a three-dimensional (3D) movie theater. That is, the augmented reality device 100 according to the embodiment can be used to view not only a virtual-real combined display screen, but also a 3D video when the processor 34 opens the active shutter lens 33. That is, the augmented reality device 100 can be compatible with both polarization and active shutter modes.

Referring to fig. 14, fig. 14 is an enlarged structural view of a region a in the structure shown in fig. 3 according to a fourth embodiment.

The augmented reality device of the present embodiment is different from the augmented reality device 100 of the first embodiment in that the augmented reality device 100 further includes a zoom unit 50, and the zoom unit 50 is mounted on the inner surface 312 of the coupler 31 and covers the inner surface 312 of the coupler 31. That is, the zoom device 50 is located on a side of the coupler 31 near the human eye to correct the vision of the user.

When the user has a vision problem such as myopia, hyperopia, or astigmatism, the zoom device 50 may correct ametropia of the user when the user views a virtual scene carrying digital content or an external real scene, improve the clarity of the user viewing the virtual scene or the external real scene, and improve the user experience of the user using the augmented reality device 100. The zoom device 50 may be a liquid crystal lens, a liquid lens, an Alvarez lens, a mechanical zoom lens, or the like. It should be understood that the zoom device 50 may be an optical device with fixed focal power, such as a lens with optical power, or an optical device with adjustable focal power coupled to the processor 34, and when the user uses the augmented reality device 100, the user can adjust the focal power of the zoom device 50 to match the vision of the user according to the focal power of the user, so as to improve the adaptability of the augmented reality device 100, and further improve the flexibility of the augmented reality device 100.

Referring to fig. 15, fig. 15 is an enlarged structural view of a region a in the structure shown in fig. 3 according to a fifth embodiment.

The augmented reality device 100 of the present embodiment is different from the third augmented reality device 100 in that the augmented reality device 100 further includes an eye tracking assembly 60. The eye tracking assembly 60 is mounted to the frame 10 for tracking the eye. The processor 34 is coupled to the zoom lens 50 and the eye tracking assembly 60 for adjusting the optical power of the zoom lens 50.

In this embodiment, the eye-tracking assembly 60 is mounted on the frame 11 of the frame 10 and faces the inner side of the frame 11. The eye tracker 60 includes one or more infrared light-emitting diodes (IR LEDs) 61 and one or more infrared cameras (IR cameras) 62. Specifically, the infrared led 61 is mounted on the first frame 131 and faces the inner side of the lens frame 11. The infrared camera 62 is mounted to the second rim 133 and faces the inside of the frame 11. The infrared light emitting diode 61 emits infrared light, the infrared light enters the eyeball of the user, is reflected by the cornea of the user and enters the infrared camera 52 for imaging, and the processor 34 determines the optical axis direction of the user by determining the spot position of the infrared light in the image and determines the sight line direction of the user after calibration. It should be noted that the eye tracker 60 of the present embodiment is not limited to the above-mentioned eye tracking technology, and other eye tracking technologies are all possible, and the present application is not limited thereto.

When the processor 34 executes the first operation, the image projector 32 is turned off, the tunable grating 316 is adjusted to the first state, and the focal power of the zoom device 50 is adjusted to the first focal power, that is, the tunable grating 316 is in the first state, the image projector 32 is in the off state, and when the focal power of the zoom device 50 is the first focal power, the zoom device 50 can correct ametropia of the user when the user watches an external real scene, improve definition of the user when the user watches the real scene, and improve use feeling of the user. When the user has visual problems such as myopia, hyperopia or astigmatism, the first focal power is the diopter of the eyeball of the user.

When the processor 34 executes the second operation, the image projector 32 is turned on, and the tunable grating 316 is adjusted to the second state, that is, the tunable grating 316 is in the second state, when the image projector 32 is in the on state, the eye tracking assembly 60 obtains the convergence depth of the virtual scene viewed by the eyes, and the processor 34 adjusts the focal power of the zoom device 50 to the second focal power according to the obtained result of the eye tracking assembly 60. Specifically, the eye tracking assembly 60 tracks the eye lines of the eyes, determines the convergence depth of the virtual scene observed by the user according to the direction of the eye lines of the user, and the processor 34 changes the virtual image distance of the virtual scene according to the convergence depth, and adjusts the position of the virtual scene to the convergence depth. Wherein the second optical power is the sum of the first optical power and the inverse of the depth of the virtual image as viewed by the user. At this time, the zoom device 50 may not only correct ametropia of the user when the user observes the virtual digital content to improve the definition of the user when the user watches the digital content, improve the use feeling of the user, but also change the virtual image distance of the digital content, solve the vergence-accommodation conflict (VAC), reduce the uncomfortable feeling of the user when using the augmented reality device 100, and improve the comfort level of the user when using the augmented reality device 100.

Next, for ease of understanding, the operation states of the tunable grating 316, the image projector 32, the active shutter lens 33, and the zoom device 50 at each time period when the augmented reality apparatus 100 is in operation will be exemplified. Wherein, in the range of 0-t ₁₂ Time period, both eyes of user have D ₀ Refractive error of (e.g., -4.0D) the description is given for the sake of example.

Referring to fig. 16, fig. 16 is a schematic diagram illustrating an operation state of the tunable grating 316, the image projector 32, the active shutter lens 33, and the zoom lens 50 when the augmented reality apparatus 100 shown in fig. 15 is in operation.

In this embodiment, the augmented reality device 100 operates at 0-t ₁ 、t ₂ -t ₃ 、t ₄ -t ₅ 、t ₆ -t ₇ 、t ₈ -t ₉ And t ₁₀ -t ₁₁ During the time period, the processor 34 executes a first operation, the tunable grating 316 is in a first state, the image projector 32 is in an open state, the active shutter lens 33 is in a second state, and the processor 34 determines the depth of a virtual image observed by the user according to the user's gaze direction obtained by the eye tracker 60At L (e.g. 0.5 m), the inverse of the virtual image depth Δ D is 1/L (e.g. -2.0D), and the power of the zoom 50 is adjusted to D ₀ + Δ D (e.g., -6.0D). At this time, the second power of the zoom lens 50 is D ₀ + Δ D, not only may ensure that the display light projected by image projector 32 does not leak out of augmented reality device 100, but also may ensure that the user clearly views the digital content.

At t ₁ -t ₂ 、t ₃ -t ₄ 、t ₅ -t ₆ 、t ₇ -t ₈ 、t ₉ -t ₁₀ And t ₁₁ -t ₁₂ During the time period, the processor 34 performs the second operation, the tunable grating 316 is in the third state, the image projector 32 is in the closed state, and the active shutter lens 33 is in the fourth state, and the processor 34 adjusts the optical power of the zoom device 50 to D ₀ . At this time, the first power of the zoom 50 is D ₀ To ensure that the human eye can see the real scene of the outside clearly through the active shutter lens 33 and the combiner 31.

The present application further provides a display method of any one of the above augmented reality devices 100, including: the first operation and the second operation are alternately performed. Specifically, processor 34 alternates between performing the first operation and performing the second operation.

In a first period, a first operation is performed to turn on the image projector 32, adjust the tunable grating 316 to a first state, and adjust the active shutter lens 33 to a second state, so that the image projector 32 projects the display light L to the combiner 31 ₀ Part of the display light L ₀ Emerging from the inner surface 312 of the coupler 31, part of the display light L ₀ The ambient light Lc emitted from the outer surface 313 of the coupler 31 is emitted to the outer surface of the active shutter lens 33, and the active shutter lens 33 blocks the display light L emitted from the outer surface 313 of the coupler 31 ₀ And ambient light Lc directed to the outer surface of the active shutter lens 33.

Specifically, processor 34 performs a first operation to turn on image projector 32, adjust tunable grating 316 to a first state, and adjust active shutter lens 33 to a second state, active shutter lens 32 preventing light from exiting outer surface 313 of coupler 31Display light L ₀ Is emitted into the external environment, thereby avoiding the display light L carrying digital content ₀ Reveal away, not only can improve user's privacy nature and augmented reality equipment 100's sociality, can also avoid revealing the display ray L who goes out ₀ A small display window is formed on the surface of the augmented reality apparatus 100, and the aesthetic appearance of the user when using the augmented reality apparatus 100 is improved. In addition, the active shutter lens 33 also prevents ambient light Lc from striking the tunable grating 316, eliminating the rainbow effect.

In the second period, the second operation is performed, the image projector 32 is turned off, the tunable grating 316 is adjusted to the third state, and the active shutter lens 33 is adjusted to the fourth state, so that the ambient light Lc passes through the active shutter lens 33, enters the combiner 31 from the outer surface 313 of the combiner 31, and exits from the inner surface 312 of the combiner 31.

Specifically, the processor 34 executes the first operation to turn off the image projector 32, adjust the tunable grating 316 to the third state, and adjust the active shutter lens 33 to the fourth state, so that the user can view the external real scene through the coupler 31 and the active shutter lens 33 to ensure that the augmented reality device 100 has a certain transmittance. Wherein the length of the second period is equal to the length of the first period. It should be noted that, in other embodiments, the length of the second time period may also be greater than or less than the length of the first time period, which is not specifically limited in this application.

In this embodiment, the first period and the second period are alternately performed. Wherein the first period and the second period form a cycle, and the cycle is less than or equal to 1/60 second. It is to be understood that the flicker frequency perceivable to the human eye is 60Hz. Since one period is less than or equal to 1/60 second. I.e. 1 second comprises at least 60 periods. That is, the first period and the second period occur at least 60 times within 1 second. At this time, the alternating frequency of the first time period and the second time period is greater than 120Hz, and according to a visual persistence phenomenon (also called a visual pause phenomenon or an afterglow effect), human eyes cannot perceive the switching between the virtual scene and the external real scene, which means that human eyes can see both the existence of the virtual scene and the external real fieldPresence of a scene. That is, it is possible to not only eliminate the rainbow effect but also block the display light L leaked from the substrate on the premise of ensuring the transmittance of the augmented reality device 100 ₀ 。

It should be noted that, in the display method of the enhanced display apparatus shown in the present embodiment, the transmittance of the augmented reality device 100 may be adjusted by adjusting a time ratio of the first period and the second period. For example, when the time of the first period of time accounts for 20% of the whole period, the transmittance of the augmented reality device 100 is only reduced by 20%, that is, on the premise of ensuring the transmittance of the augmented reality device 100, not only the rainbow effect is eliminated, but also the leakage light L to the combiner 31 is realized ₂ The shielding of (2) improves the use experience of users.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An augmented reality device comprising a frame, a coupler, an active shutter lens, an image projector and a processor, wherein the coupler is mounted to the frame, the coupler comprises a tunable grating, the active shutter lens is mounted to the outside of the coupler and covers the tunable grating, the image projector is mounted to the frame, and the processor is coupled to the tunable grating, the active shutter lens and the image projector for alternately performing a first operation and a second operation;

the first operation comprises the steps of starting the image projector, adjusting the tunable grating to a first state, and adjusting the active shutter lens to a second state, wherein the image projector projects display light to the combiner, the display light is diffracted at the tunable grating to form diffraction light, part of the diffraction light is emitted to the inner side of the combiner, and the active shutter lens shields ambient light emitted to the tunable grating;

the second operation includes turning off the image projector, adjusting the tunable grating to a third state, and adjusting the active shutter lens to a fourth state, and ambient light passing through the active shutter lens and the tunable grating is emitted to the inside of the combiner.

2. The augmented reality device of claim 1, wherein the processor is configured to perform the first operation for a first period of time and is further configured to perform the second operation for a second period of time, the first period of time and the second period of time forming a cycle, the cycle being less than or equal to 1/60 of a second.

3. Augmented reality device according to claim 1 or 2, wherein the active shutter glasses cover the combiner.

4. The augmented reality device of any one of claims 1-3, wherein the active shutter glasses comprise a liquid crystal cell coupled to the processor, a first polarizer located on a side of the liquid crystal cell facing away from the combiner, and a second polarizer located between the liquid crystal cell and the substrate, wherein an angle between transmission axis directions of the first and second polarizers is 90 degrees.

5. The augmented reality device of claim 4, further comprising a quarter-wave plate, wherein the quarter-wave plate is mounted on an outer surface of the first polarizer, and an included angle between a fast axis direction of the quarter-wave plate and a transmission axis direction of the first polarizer is 45 degrees.

6. The augmented reality device of any one of claims 1 to 5, wherein the augmented reality device comprises two augmented reality components, the two augmented reality components being mounted to the frame at a distance, each augmented reality component comprising the coupler, the image projector and the active shutter lens, the couplers of the two augmented reality components being arranged side by side.

7. The augmented reality device of claim 6, wherein the active shutter glasses of each augmented reality component comprise a liquid crystal cell coupled to the processor, a first polarizer located on a side of the liquid crystal cell facing away from the substrate, and a second polarizer located between the liquid crystal cell and the substrate, and an included angle between transmission axis directions of the first polarizer and the second polarizer of each augmented reality component is 90 degrees.

8. The augmented reality device of claim 7, wherein the augmented reality device comprises two quarter-wave plates, one of the quarter-wave plates is mounted on an outer surface of one of the first polarizers, and an angle between a fast axis direction of one of the quarter-wave plates and a transmission axis direction of one of the first polarizers is 45 degrees, the other of the quarter-wave plates is mounted on an outer surface of the other of the first polarizers, and an angle between a fast axis direction of the other of the quarter-wave plates and a transmission axis direction of the other of the first polarizers is 45 degrees.

9. The augmented reality device of claim 8, wherein the transmission axis directions of the two first polarizers are the same, and the included angle between the fast axis directions of the two quarter-wave plates is 90 degrees, or the included angle between the transmission axis directions of the two first polarizers is 90 degrees, and the fast axis directions of the two quarter-wave plates are the same.

10. Augmented reality device according to any one of claims 1-9, further comprising a zoom mounted inside the combiner.

11. The augmented reality device of claim 10, further comprising an eye tracking assembly mounted to the frame, the processor further coupling the zoom and the eye tracking assembly;

the processor is used for turning off the image projector and adjusting the focal power of the zoom to be a first focal power;

the processor is used for starting the image projector, the eyeball tracking assembly is used for acquiring the convergence depth of a virtual scene watched by eyeballs, and the processor adjusts the focal power of the zoom device to be a second focal power according to the acquisition result of the eyeball tracking assembly.

12. A display method of an augmented reality device, wherein the augmented reality device includes a frame, a coupler, an active shutter lens and an image projector, the coupler is mounted to the frame, the coupler includes a tunable grating, the active shutter lens is mounted to an outer side of the coupler and covers the tunable grating, the image projector is mounted to the frame, and the display method of the augmented reality device includes:

alternately performing a first operation and a second operation;

the first operation comprises the steps of starting the image projector, adjusting the tunable grating to a first state, and adjusting the active shutter lens to a second state, wherein the image projector projects display light to the substrate, the display light is diffracted at the tunable grating to form diffraction light, part of the diffraction light is emitted to the inner side of the combiner, and the active shutter lens shields ambient light emitted to the tunable grating;

the second operation comprises closing the tunable grating, adjusting the tunable grating to a third state, adjusting the active shutter lens to a fourth state, and emitting ambient light to the inner side of the combiner after passing through the active shutter lens and the tunable grating.

13. The display method of augmented reality equipment according to claim 12, wherein the first operation is performed in a first period, and the second operation is performed in a second period, the first period and the second period forming a cycle, the cycle being less than or equal to 1/60 second.