CN112213860B

CN112213860B - Augmented reality device, wearable augmented reality equipment and method for controlling augmented reality device

Info

Publication number: CN112213860B
Application number: CN202011287560.1A
Authority: CN
Inventors: 肖冰
Original assignee: Shining Reality Wuxi Technology Co Ltd
Current assignee: Shining Reality Wuxi Technology Co Ltd
Priority date: 2020-11-17
Filing date: 2020-11-17
Publication date: 2023-04-18
Anticipated expiration: 2040-11-17
Also published as: CN116224600A; CN112213860A

Abstract

The disclosure relates to an augmented reality device, wearable augmented reality equipment and a method for controlling the augmented reality device, and relates to the technical field of augmented reality. The controller can adjust the adjusting operation of the light intensity of the first ambient light or/and the light intensity of the external ambient light sent by the ambient light detector according to the obtained representation to generate a first control signal, the state of the first optical assembly is adjusted based on the first control signal, and the light intensity of the second ambient light emitted to the target area through the first optical assembly and the second optical assembly can be changed, such as enhanced or weakened, so that the display effect of the augmented reality device is improved.

Description

Augmented reality device, wearable augmented reality equipment and method for controlling augmented reality device

Technical Field

The present disclosure relates to the field of augmented reality technologies, and in particular, to an augmented reality device, a wearable augmented reality device, and a method of controlling the augmented reality device.

Background

AR (Augmented Reality), also called mixed Reality, applies virtual information to the real world, so that real environment and virtual objects are superimposed on the same picture or space in real time and exist simultaneously. Currently, people can interact with the real world through wearable devices, such as AR glasses or AR helmets.

However, the existing wearable augmented reality device cannot effectively adjust the light intensity of the incident ambient light for real environment display in the using process, so that the display effect of the wearable augmented reality device is poor.

Disclosure of Invention

The utility model provides an augmented reality device and wearing formula augmented reality equipment to through the ingenious design to AR display device, adjust the light intensity of the second ambient light that obtains through the augmented reality device jets out to the target area through external ambient light, if strengthen or weaken, thereby improve the display effect of augmented reality device. The technical scheme of the disclosure is as follows:

according to a first aspect of the embodiments of the present disclosure, there is provided an augmented reality apparatus, including: an image source for emitting image light; a first optical assembly for receiving ambient light; the second optical assembly is used for guiding the first ambient light emitted by the first optical assembly and the image light emitted by the image source to a target area, and the target area is an exit surface area of the second optical assembly corresponding to a maximum image display area which can be formed by the target image light emitted by the image source through the second optical assembly; the target area comprises at least one sub-area, and the sub-area is determined according to the fact that the light intensity of the image light is larger than a set threshold value;

an ambient light detector for detecting a light intensity of the ambient light;

a controller configured to be connected to the ambient light detector, generate a first control signal according to the obtained information related to the intensity of the ambient light, where the information related to the intensity of the ambient light includes at least one of adjustment information indicating that the intensity of the second ambient light emitted to the target area via the first optical assembly and the second optical assembly is adjusted and light intensity information of the external ambient light sent by the ambient light detector; wherein the first control signal only adjusts the second ambient light that exits to the target area via the first optical assembly and the second optical assembly, and does not adjust outside the target area;

the first optical assembly is further configured to be connected to the controller, and can adjust an area corresponding to a target area according to the obtained first control signal, so that the light intensity or the polarization direction of the emergent first ambient light changes, and the light intensity of the second ambient light in the target area is adapted to the target image light;

the controller is further configured to adjust, for each of the sub-regions, the light intensity of the second ambient light corresponding to the sub-region by adjusting the state of the corresponding sub-region on the first optical assembly, so that the light intensity of the second ambient light and the light intensity of the target image light of the sub-region respectively match, without adjusting the state of the corresponding first optical assembly outside the sub-region, and adjust the transparency within the boundary range of the sub-region to gradually increase along a direction approaching the inside of the sub-region to the outside of the sub-region, wherein the boundary range of the sub-region is determined by a first set distance of the boundary of the sub-region toward the inside of the sub-region and/or a second set distance of the boundary toward the outside of the sub-region.

According to a second aspect of the embodiments of the present disclosure, a wearable augmented reality device is provided, which includes a glasses frame and glasses legs, and the augmented reality device is disposed in the glasses frame.

According to a third aspect of embodiments of the present disclosure, there is provided a method of controlling an augmented reality device, wherein the augmented reality device includes an image source, an ambient light detector, a first optical component capable of changing a light intensity or a polarization direction of light passing therethrough, and a second optical component; the second optical assembly guides ambient light and image light emitted by an image source to a target area; the target area is an emergent surface area of the second optical assembly corresponding to a maximum image display area which can be formed by target image light emitted by the image source through the second optical assembly; the target area comprises at least one subarea, and the subarea is determined according to the condition that the light intensity of the image light is greater than a set threshold value;

the method comprises the following steps:

generating a first control signal according to the obtained information related to the light intensity of the ambient light, wherein the information related to the light intensity of the ambient light comprises at least one of adjustment information representing adjustment of light intensity of ambient light emitted from the augmented reality device and light intensity information of external ambient light where the augmented reality device is located, the adjustment information being sent by the ambient light detector; wherein the first control signal only adjusts the second ambient light that exits to the target area via the first optical assembly and the second optical assembly, and does not adjust outside the target area;

applying the first control signal for changing the light intensity or polarization direction of the ambient light passing through the first optical assembly to the first optical assembly, so that the light intensity of the emergent ambient light is attenuated to a corresponding degree compared with the light intensity of the external ambient light; adjusting the region corresponding to the target region according to the obtained first control signal, so that the light intensity or the polarization direction of the first ambient light emitted by the first optical assembly is changed, and the light intensity of the second ambient light in the target region is adapted to the target image light;

and adjusting the light intensity of the second environment light corresponding to each sub-area by adjusting the state of the corresponding sub-area on the first optical assembly aiming at each sub-area, so that the light intensity of the second environment light of each sub-area is respectively matched with the light intensity of the target image light, the state of the first optical assembly corresponding to the outside of the sub-area is not adjusted, and the transparency in the boundary range of the sub-area is adjusted to gradually increase along the direction from the inside close to the sub-area to the outside of the sub-area, wherein the boundary range of the sub-area is determined by a first set distance from the boundary of the sub-area to the inside of the sub-area and/or a second set distance from the boundary of the sub-area to the outside of the sub-area.

The embodiment of the present disclosure adopts at least one technical scheme that can achieve the following beneficial effects:

through set up environment light detector, controller, image source, first optical assembly and second optical assembly in the augmented reality device for the controller can be according to the regulation operation of the light intensity of the demonstration regulation external environment light that obtains and at least one in the light intensity of the external environment light that environment light detector sent generates first control signal, and first optical assembly obtains first control signal and the state changes, and external environment light jets out to the target area through first optical assembly and second optical assembly and obtains second environment light, because the state of first optical assembly changes and leads to the light intensity reinforcing or weakening of second environment light, thereby improve the display effect of augmented reality device, satisfy user's watching demand.

Drawings

The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this disclosure, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure and not to limit the disclosure.

Fig. 1 is a schematic structural diagram of an augmented reality apparatus according to an exemplary embodiment.

Fig. 2 is a schematic structural diagram of an augmented reality apparatus according to another exemplary embodiment.

Fig. 3 is a schematic structural diagram of an augmented reality apparatus according to still another exemplary embodiment.

Fig. 4 is a schematic structural diagram of an augmented reality apparatus according to still another exemplary embodiment.

Fig. 5 is a schematic structural diagram of an augmented reality apparatus according to still another exemplary embodiment.

Fig. 6 is a schematic structural diagram of an augmented reality apparatus according to still another exemplary embodiment.

Fig. 7 is a schematic structural diagram of an augmented reality apparatus shown according to still another exemplary embodiment.

Fig. 8 is a schematic structural diagram of an augmented reality apparatus according to still another exemplary embodiment.

Fig. 9 is a schematic structural diagram of an augmented reality apparatus according to still another exemplary embodiment.

Fig. 10 is a flowchart illustrating a method of controlling an augmented reality device according to an exemplary embodiment.

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

Detailed Description

To make the objects, technical solutions and advantages of the present disclosure more apparent, the following embodiments of the present disclosure will be clearly and completely described in conjunction with the accompanying drawings. It is to be understood that the described embodiments are merely a subset of the disclosed embodiments and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

The technical solutions provided by the embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

It should be understood that, in the following embodiments, the external ambient light refers to ambient light before entering the first optical component (i.e. the augmented reality device), the first ambient light refers to ambient light emitted through the first optical component, and the second ambient light refers to ambient light guided to the target area through the second optical component. The target area is an emergent surface area of the second optical assembly corresponding to a maximum image display area formed by target image light emitted by an image source through the second optical assembly.

Example one

As shown in fig. 1, a schematic structure diagram of an augmented reality device 10 is provided for an exemplary embodiment, where the augmented reality device 10 may include at least an ambient light detector 11, a controller 12, a first optical assembly 13, an image source 14, and a second optical assembly 15, and the controller 12 is connected to the ambient light detector 11 and the first optical assembly 13, respectively.

The ambient light detector 11 is configured to detect a light intensity of the ambient light, and the light intensity of the ambient light detected by the ambient light detector 11 is used to represent the light intensity of the ambient light received by the first optical assembly 13. The ambient light detector 11 may be disposed close to the first optical assembly 13, so that the light intensity of the ambient light detected by the ambient light detector 11 is closer to the light intensity of the ambient light actually received by the first optical assembly 13. Alternatively, the ambient light detector may be selected from, but not limited to, a photoresistor, a photocell, a photodiode, and the like. In addition, in practical implementation, the actual setting position of the ambient light detector 11 may be set according to requirements, for example, when a high light-transmitting cover plate for protecting the first optical component without affecting ambient light transmission is provided in the augmented reality device 10, the ambient light detector 11 may be provided between the first optical component 13 and the high light-transmitting cover plate, and the like.

The controller 12 is configured to generate a first control signal according to the obtained information related to the light intensity of the ambient light, the information related to the light intensity of the ambient light including at least one of an adjustment operation representing adjustment of the light intensity of the second ambient light emitted to the target area via the first optical assembly and the second optical assembly and light intensity information of the ambient light sent by the ambient light detector 11. For example, the controller 12 sends the first control signal to adjust the state of the first optical assembly 13, so that the light intensity of the external environment light passing through the first optical assembly 13 and the second optical assembly 15 is attenuated, for example, the difference between the light intensity of the second environment light and the light intensity of the external environment light may be increased or decreased, that is, the degree of attenuation of the light intensity of the second environment light relative to the light intensity of the external environment light is different.

In practical implementation, the controller 12 may compare the obtained external environment light detection result (i.e., the signal indicating the light intensity of the external environment light) sent by the environment light detector 11 with a preset reference signal, and further generate a first control signal (e.g., a current or voltage signal with different magnitudes) according to the comparison result and send the first control signal to the first optical assembly 13. It can be understood that the reference signal may be preset in the augmented reality device 10, or may be manually set by a user in real time according to a requirement, which is not limited in this embodiment.

In one implementation, the predetermined reference signal may be a fixed value or a fixed range, in order to adjust the light intensity of the second ambient light to a designed range, for example, the greater the difference between the external ambient light detection result and the predetermined reference signal is, the greater the difference between the light intensity of the second ambient light and the light intensity of the external ambient light is, the greater the attenuation degree of the light intensity of the second ambient light compared with the light intensity of the external ambient light is.

In another implementation manner, the preset reference signal may also be condition information related to time, a place, and a preset condition, and when at least one of the time, the place, and the preset condition is satisfied, the light intensity of the second ambient light is adjusted according to the preset reference signal corresponding to the condition information. For example, different preset reference signals are set according to different geographic positions, and when the location of the augmented reality device 10 is located at different set geographic positions, the light intensity of the second ambient light is adjusted according to the corresponding preset reference signals, which is beneficial to controlling the light intensity of the second ambient light according to the illumination conditions of different locations, and the immersion degree is better.

Further, referring to fig. 1 again, when the controller 12 generates the first control signal according to the obtained adjustment operation indicating that the light intensity of the second ambient light is adjusted, the augmented reality device 10 itself or a main control element (such as a remote controller) connected to the augmented reality device 10 may be provided with a key for a user to operate, so that the user initiates the light intensity adjustment operation. It is to be understood that the "adjustment operation" shown in fig. 1 may be obtained by the user directly operating the controller 12, or may be obtained by indirectly operating the controller through a remote controller or the like. In one implementation, the user may adjust the light intensity according to his or her own preferences, for example, if the user prefers to experience augmented reality effects using the augmented reality device 10 under different light intensity conditions of the second ambient light, then the light intensity may be increased/decreased according to his or her own preferences. Optionally, in order to facilitate the user to adjust the light intensity of the ambient light, a plurality of light intensity intervals [ A1, A2], [ A3, A4], [ A5, A6] ..., may be preset, so that the user may directly select the corresponding light intensity interval to initiate the light intensity adjustment operation.

In addition, in practical applications, after the user selects the corresponding light intensity interval (e.g., [ A3, A4 ]), the controller may further use the light intensity interval [ A3, A4] as a reference, and generate a first control signal according to the external environment light detection result sent by the ambient light detector 11, so as to further adjust the light intensity of the second ambient light in the light intensity interval [ A3, A4 ]. It should be noted that, at this time, when the controller adjusts the light intensity of the second ambient light according to the first control signal generated from the detection result of the external ambient light sent by the ambient light detector 11, the adjusted light intensity of the second ambient light needs to be located in the aforementioned light intensity interval [ A3, A4 ].

The first optical element 13 is configured to receive the external environment light, and change the light intensity or the polarization direction of the emitted first environment light according to the control signal sent by the controller 12, so that the light intensity of the second environment light is attenuated to a corresponding degree compared with the light intensity of the external environment light, for example, the light intensity of the second environment light emitted to the target area through the first optical element 13 and the second optical element 15 is enhanced or attenuated. In practical applications, only the light intensity of the second ambient light in the target area may be adjusted, and the ambient light corresponding to the outside of the target area entering the augmented reality device 10 is not adjusted, the external environment outside the target area may be clearly shown (the first control signal does not adjust the outside of the target area), and the light intensity of the second ambient light in the target area may be adapted to the target image light (for example, the target image light may be clearly shown after being superimposed on the second ambient light). It should be noted that the light intensity of the second ambient light is always smaller than the light intensity of the external ambient light, and the increase or decrease of the light intensity of the second ambient light is only an increase or decrease of the difference from the light intensity of the external ambient light, i.e. the degree of attenuation of the light intensity of the second ambient light relative to the light intensity of the external ambient light is different.

For this reason, the first optical component 13 can be selected from, but not limited to, a liquid crystal component or an electro-material layer. As a possible implementation manner, when the first optical component 13 is an electro-material layer, the working principle is to control the light transmittance of the electro-material layer according to the current magnitude or the voltage magnitude (i.e., the first control signal) so as to adjust (e.g., enhance or weaken) the light intensity of the first ambient light transmitted through the electro-material layer, and further, in the augmented reality device 10, the light intensity of the second ambient light, that is, the external ambient brightness, is controllably and continuously changed.

As another possible implementation manner, considering that the arrangement direction of the liquid crystal molecules may cause the change of the polarization direction of the light passing through the liquid crystal element, generally, the polarization direction of the light passing through the liquid crystal element is adjusted by the liquid crystal element to be consistent with the arrangement direction of the liquid crystal molecules, when the first optical component 13 is a liquid crystal component, the liquid crystal element in the liquid crystal component includes a plurality of liquid crystal cells (cells), and the deflection direction of the liquid crystal molecules in the liquid crystal cells is related to the control signal applied by the controller, that is, the deflection direction of the liquid crystal molecules in the liquid crystal component may be controlled by the controller 12, and the polarization direction of the light passing through the liquid crystal element may be continuously changed. In other words, the present embodiment realizes the adjustment of the light polarization direction of the first ambient light transmitted through the liquid crystal element by introducing a feedback and adjustment mechanism, so that the controller 12 controls the deflection direction of each liquid crystal molecule in the liquid crystal element 1302, and further realizes the controllable continuous variation of the light intensity of the second ambient light, i.e. the external ambient brightness, in the augmented reality device 10. In practical implementation, the actual structure of the liquid crystal module can be flexibly designed according to the requirement, and the embodiment is not limited herein.

Image source 14 is operative to emit image light indicative of an image desired to be incident in a target area. In practical implementation, the image source 14 may be, but not limited to, a curved image source such as a concave surface type, a convex surface type, a spherical surface type, or a planar light source such as an integrated light source and a single light source, which is not limited in this embodiment.

The first ambient light emitted by the first optical assembly 13 can enter the target area through the second optical assembly 15 to obtain second ambient light, the state of the first optical assembly 13 changes according to the obtained first control signal, so that the light intensity of the second ambient light entering the target area through the first optical assembly 13 and the second optical assembly 15 is enhanced or weakened, and the image light emitted by the image source 14 enters the target area through the second optical assembly 15 to obtain target image light, so that an augmented reality image is formed. In this embodiment, the second optical assembly 15 utilizes an optical imaging principle, and may be configured to transmit the first ambient light transmitted by the first optical assembly 13, and transmit the image light emitted from the image source 14 to the target area, so as to achieve superposition of the virtual image and the real ambient image, that is, to enhance reality. In the augmented reality device, a target area (corresponding to a pixel point of an image source) may be aligned with an area of the first optical assembly receiving external ambient light, so that the area of the first optical assembly corresponding to the target area may be adjusted.

In practical implementation, in addition to the aforementioned change of the state of the first optical assembly 13 according to the first control signal, as a possible implementation manner, referring to fig. 1 again, the controller 12 is further configured to be connected to the image source 14 to generate a second control signal according to the light intensity of the image light emitted by the image source 14 and the light intensity of the external ambient light received by the first optical assembly 13, so that the light intensity of the second ambient light emitted to the target area through the first optical assembly 13 and the second optical assembly 15 is matched with the light intensity of the target image light emitted to the target area through the second optical assembly 15 by the image source 14, so as to adjust the light of the second ambient light. The light intensity of the target image light and the light intensity of the image light emitted by the image source 14 have a fixed relationship, the light intensity of the second ambient light, the light intensity of the external ambient light and the second control signal applied to the first optical assembly 13 have a fixed relationship, in order to match the light intensity of the second ambient light and the light intensity of the target image light, a matching relationship can be preset, and then the second control signal applied to the first optical assembly 13 is calculated according to the light intensity of the image light and the light intensity of the external ambient light. In addition, a second control signal may also be applied to image source 14 to control the light intensity of the image light of image source 14.

In addition, the light intensity of the second ambient light is matched with the light intensity of the target image light, and the difference between the light intensity of the second ambient light and the light intensity of the target image light is within a certain range. For example, when the light intensity of the target image light is low and the light intensity of the second ambient light is high, the user may not see the image of the image light clearly, and the light intensity of the second ambient light is made to match the light intensity of the target image light by decreasing the light intensity of the second ambient light and/or increasing the light intensity of the target image light; when the light intensity of target image light is higher and the light intensity of second environment light is lower, the user may see the formation of image of second environment light not clearly, through the light intensity of increaseing second environment light and/or the light intensity that reduces target image light to make the light intensity of second environment light match with the light intensity of target image light, augmented reality is effectual, and user experience also can be good.

It is to be understood that the aforementioned light intensity of the target image light may originate from the controller 12, i.e., the controller 12 itself knows the light intensity of the image light; alternatively, the light intensity of the target image light may be derived from other sources, such as a controller connected to the image source 14 to know the light intensity of the image source 13, and thus adjust the light intensity of the target image light.

For example, the target region may include at least one sub-region, and the sub-region is determined according to the light intensity of the image light being greater than a set threshold, the light intensity of the image light within the sub-region being greater, and the light intensity of the image light outside the sub-region being less, and the boundary of the sub-region may be defined by setting the threshold. The image light boundary can be judged by the light intensity of the image light being larger than the set threshold, and the image light boundary forms a sub-area, or the image light boundary can be judged by the light intensity of the image light being larger than the set threshold, and a fixed geometric shape or a user-defined shape is set, and the image light boundary is covered to form the sub-area formed by the boundary of the fixed geometric shape or the user-defined shape.

For example, assuming that the content of the image light is a tree, by judging the light intensity of the image light, the edge of the tree can be determined as the image light boundary, i.e., the sub-region is the tree. For another example, in the above-mentioned example of the tree, after the edge of the tree is determined, the set rectangular frame covers the edge of the tree, that is, the sub-region is the set rectangular frame. If the content of the image light includes children playing under the tree, the children and the tree may be determined as two sub-areas, respectively, or the children and the tree may be determined together as one sub-area. All sub-regions are located within the target region, and all sub-regions may not fill the target region, e.g., a space is provided between a plurality of sub-regions. Each subregion may be aligned with a region of the first optical assembly receiving the ambient light, respectively, so as to adjust for the target image light and/or the second ambient light of each subregion.

The controller 12 may be further configured to generate a third control signal according to the light intensity of the image light emitted by the image source 14 and the light intensity of the external environment light received by the first optical assembly 13, so that the light intensity of the second environment light emitted to the sub-area via the first optical assembly 13 and the second optical assembly 15 matches the light intensity of the target image light emitted to the corresponding sub-area by the image source 14 via the second optical assembly 15. For example, assuming that the target region includes three subregions and the light intensity of the image light of the three subregions is different, the controller 12 may adjust the light intensity of the second ambient light of the corresponding subregion by adjusting the state of the corresponding subregion of the first optical assembly 13 for each subregion, so that the light intensity of the second ambient light of the three subregions and the light intensity of the target image light are respectively matched. In addition, the light intensity of the image light of image source 14 corresponding to the sub-region may be adjusted to match the light intensity of the second ambient light of the sub-region to the light intensity of the target image light.

In some embodiments, the controller may be configured to generate the fourth control signal such that the light intensity of the second ambient light emitted to the sub-area via the first and second

optical assemblies

13, 15 is increased or decreased according to at least one of an adjustment operation indicating that the light intensity of the second ambient light emitted to the sub-area is adjusted and the light intensity of the external ambient light transmitted by the ambient light detector 11. For example, the target area includes three sub-areas, and the controller 12 may adjust the light intensity of the second ambient light of the corresponding sub-area by adjusting the state of the corresponding sub-area of the first optical assembly 13 for each sub-area, so that the light intensity of the second ambient light of the three sub-areas is different.

In some embodiments, the transparency of the subregion is less than the transparency outside the subregion. The transparency refers to a ratio of light intensity of the external environment light penetrating through the augmented reality device to light intensity of the external environment light, and the greater the transparency, the less light intensity the external environment light loses when passing through the augmented reality device. And adjusting the state of the first optical assembly corresponding to the sub-area to weaken the light intensity of the second ambient light corresponding to the sub-area, and not adjusting the state of the first optical assembly corresponding to the sub-area to make the light intensity of the second ambient light corresponding to the sub-area smaller than the light intensity of the second ambient light corresponding to the sub-area. When the light intensity of the external environment light is very large, the target image light corresponding to the sub-region can be clearly shown by only weakening the light intensity of the second environment light corresponding to the sub-region, and the second environment light corresponding to the outside of the sub-region can also be clearly shown without weakening, so that the user can clearly see the image content shown by the sub-region and the environment content outside the sub-region.

In further embodiments, the transparency of the boundary extent of the sub-region is greater than the transparency of the interior of the sub-region, the boundary extent of the sub-region being determined by a first set distance of the boundary of the sub-region towards the interior of the sub-region and/or a second set distance towards the exterior of the sub-region. In the example where the sub-region is a tree, a boundary range may be formed with the boundary of the tree as a starting point and the first set distance as an end point in a direction in which the boundary of the tree faces the inside of the tree; and/or forming a boundary range by taking the boundary of the tree as a starting point and the second set distance as an end point in the direction from the boundary of the tree to the outside of the tree. The first set distance and the second set distance can be adjusted by a user as needed.

In the foregoing embodiment, the transparency of the boundary range of the sub-region may be greater than the transparency of the inside of the sub-region by adjusting the boundary range of the sub-region and the light intensity of the second ambient light inside the sub-region. For example, the light intensity of the second ambient light adjusting the boundary range of the sub-region is greater than the light intensity of the second ambient light inside the sub-region.

Further, in order to make the user more realistic when observing the image content and reduce the obtrusiveness, the transparency within the boundary of the sub-region gradually increases along the direction from the inside of the sub-region to the outside of the sub-region.

In some embodiments, the transparency of the portion of the sub-region corresponding to the environmental object is less than the transparency of the portion of the sub-region corresponding to the non-environmental object. In some outdoor game scenes, the sub-regions can be formed by game characters, when the game characters stand in front of environment objects such as stones, the environment objects such as the stones corresponding to the game characters can be shielded, the transparency of the parts of the sub-regions corresponding to the environment objects is smaller than that of the parts of the sub-regions not corresponding to the environment objects, the real situation is better met, and the immersion feeling of users is better. This may be achieved by adjusting the light intensity of the second ambient light of the portion of the sub-area corresponding to the environmental object to be less than the light intensity of the second ambient light of the portion of the sub-area not corresponding to the environmental object.

In some embodiments, an eye tracking device may be disposed on the augmented reality device 10, the target region or the sub-region is related to a gaze point of the augmented reality device 10, a change of the gaze point may be obtained by the eye tracking device, a position of the target region or the sub-region may be obtained according to the gaze point information obtained by the eye tracking device, and then the light intensity of the corresponding second environment light may be adjusted according to the position of the target region or the sub-region.

As can be seen from the foregoing description, the controller 12, the ambient light detector 11, the image source 14, the first optical component 13, and the second optical component 15 are disposed in the augmented reality device 10, so that the light intensity of the second ambient light can be continuously adjusted, the display effect of the augmented reality device 10 is effectively improved, and the user experience is improved.

Based on the augmented reality device 10 given above, considering that there are many possible implementations of the augmented reality device given above if the first optical component 13 and the second optical component 15 are different in structure, several possible implementations of the augmented reality device given in this embodiment are described below with reference to the drawings. In some implementations shown in the following drawings, when the second optical assembly 15 has a transflective element and the image source 14 is mounted with an optical lens, a distance between the image source 14 and the transflective element needs to satisfy a light path design requirement of optical imaging to ensure an imaging effect of the augmented reality device 10. In addition, the image source 14 and the polarizer in the second optical assembly 15 may be directly attached to each other, or may be fixed by a mechanical component, etc., which is not limited in this embodiment.

In addition, the polarizer described below has a characteristic of controlling the polarization state of light, and transmits the first polarization state and absorbs the light of the second polarization state, or transmits the second polarization state and absorbs the light of the first polarization state; the polarization light splitting element has the characteristics of reflecting light rays in a first polarization state and transmitting light rays in a second polarization state, or transmitting light rays in a first polarization state and transmitting light rays in a first polarization state; the transflective element has the characteristics of reflecting and transmitting incident light rays, and does not distinguish the polarization characteristics of the light rays. The first polarization state and the second polarization state indicate that the vibration directions of the light rays are different. The first direction of the first polarization state and the second direction of the second polarization state are perpendicular to each other. For example, the light having the first polarization state may be polarized light having a polarization state of P direction, and the light having the second polarization state may be polarized light having a polarization state of S direction. Considering that the P-polarized light and the S-polarized light can rotate around the light propagation direction on the premise of being perpendicular to each other, the first polarization state may also be the polarized light with a polarization state forming a certain angle with the P direction, and the second polarization state may also be the polarized light with a polarization state forming a certain angle with the S direction, which is not limited in this embodiment.

Example 1

Referring to fig. 2, when the first optical device is a liquid crystal device, the liquid crystal device may at least include a first polarizer 1300, a second polarizer 1301 and a liquid crystal element 1302, and the liquid crystal element 1302 includes a plurality of liquid crystal cells, wherein the liquid crystal element 1302 is connected to the controller 12 and is located between the first polarizer 1300 and the second polarizer 1301.

In actual implementation, the working principle of the liquid crystal module for adjusting the intensity of light is different according to the difference between the polarization states (polarization directions) of the first polarizer 1300 and the second polarizer 1301 shown in fig. 2. The polarization directions of the first polarizer 1300 and the second polarizer 1301 are not limited to the following specific embodiments, and the polarization directions of the first polarizer 1300 and the second polarizer 1301 may have other angles.

For example, assuming that the polarization state of the polarized light transmitted by the first polarizer 1300 and the polarization state of the polarized light transmitted by the second polarizer 1301 are the same, for example, both are the second polarization state, the transmission of the first ambient light transmitted through the liquid crystal assembly 130 is as follows.

As shown in fig. 2 (a), when external ambient light enters the second polarizer 1301 and is transmitted therethrough, the polarization state of the ambient light is changed to a second polarization state, the ambient light in the second polarization state further propagates to the liquid crystal cell 1302, the liquid crystal cell 1302 is controlled by the first control signal sent by the controller 12, and the arrangement direction of the liquid crystal molecules in the liquid crystal cell is changed, so that the polarization direction of the light after passing through the liquid crystal cell is changed. For example, when the external environment light is strong, or the user using the augmented reality device 10 is not satisfied with the brightness of the current external environment light, the controller 12 may send a first control signal to the liquid crystal element 1302 to adjust the light transmittance of the liquid crystal element 1302 according to the obtained adjustment operation or/and the external environment light detection result sent by the environment light detector 11. Then:

(1) When the deflection angle of the liquid crystal element 1302 to the polarization state of the transmitted ambient light is 0 °, the polarization characteristic of the transmitted ambient light is not changed after the transmitted ambient light passes through the liquid crystal element 1302, and the ambient light in the second polarization state can pass through the first polarizer 1300 and enter the second optical assembly 15 without loss.

(2) When the deflection angle of the liquid crystal element 1302 to the polarization state of the transmitted ambient light is 90 °, the ambient light is converted from the second polarization state to the first polarization state (not shown) after being transmitted by the liquid crystal element 1302, and the ambient light in the first polarization state cannot pass through the first polarizer 1300, that is, no first ambient light is incident to the second optical assembly 15, or a user using the augmented reality device 10 cannot see the external environment.

(3) When the deflection angle of the liquid crystal element 1302 to the polarization state of the transmitted ambient light is continuously changed from 0 ° to 90 °, the ambient light transmitted through the first polarizer 1300 is also continuously weakened or continuously strengthened (i.e., the first ambient light incident to the second optical assembly 15 is also gradually strengthened or gradually weakened, and even the brightness of the external environment seen by the user using the augmented reality device 10 is also gradually strengthened or gradually weakened), so as to achieve the purpose of continuous adjustment.

For another example, if the polarization state of the polarized light transmitted by the first polarizer 1300 is the second polarization state and the polarization state of the polarized light transmitted by the second polarizer 1301 is the first polarization state, the transmission of the first ambient light transmitted through the liquid crystal device is as follows.

As shown in fig. 2 (b), when the external ambient light enters and is transmitted by the second polarizer 1301, the polarization state of the ambient light is changed to the first polarization state, and the ambient light in the first polarization state further propagates to the liquid crystal element 1302, because the liquid crystal element 1302 is controlled by the first control signal sent by the controller 12. If the ambient light is strong or the user using the augmented reality device 10 is not satisfied with the current ambient brightness, the controller 12 sends a modulation signal to the liquid crystal element 1302 according to the obtained light intensity adjustment operation or/and the ambient light detection result sent by the ambient light detector 11, so as to adjust the light transmittance of the liquid crystal element 1302. Then:

(1) When the deflection angle of the liquid crystal element 1302 to the polarization state of the transmitted ambient light is 0 °, the polarization characteristic of the ambient light is not changed after the ambient light is transmitted through the liquid crystal element 1302, but because the polarization characteristic of the first polarizer 1300 is different from the polarization characteristic of the second polarizer 1301, that is, the first polarizer 1301 allows the light of the first polarization state to pass through, and the second polarizer 1300 allows the light of the second polarization state to pass through, then, the ambient light of the first polarization state cannot pass through the first polarizer 1300, that is, a user using the augmented reality device 10 cannot see the external environment.

(2) When the deflection angle of the liquid crystal element 1302 to the polarization state of the transmitted ambient light is 90 °, the ambient light transmitted by the liquid crystal element 1302 is converted from the first polarization state to the second polarization state (not shown), and the ambient light in the second polarization state is not lost when passing through the first polarizer 1300.

(3) When the deflection angle of the liquid crystal element 1302 to the polarization state of the transmitted ambient light is continuously changed from 0 ° to 90 °, the first ambient light transmitted through the first polarizer 1300 is continuously weakened or continuously strengthened (i.e. the brightness of the external environment seen by the user using the augmented reality device 10 is gradually strengthened or gradually weakened), so as to achieve the purpose of continuous adjustment.

It should be noted that (a) and (b) shown in fig. 2 respectively indicate transmission optical paths of ambient light in two different cases, and (a) and (b) shown in the subsequent fig. 3 to 6 are the same as (a) and (b) shown in fig. 2.

Example 2

When the first optical component 13 includes the first polarizer 1300, the second polarizer 1301, and the liquid crystal element 1302 shown in example 1, or the first optical component includes only the second polarizer 1301 and the liquid crystal element 1302 shown in example 1, or the first optical component 13 is an electro-material layer, the second optical component 15 may include the fourth polarizer 1501, the first transflective element 1502, and the first polarization beam splitting element 1503 shown in fig. 3, the image source 14 is disposed in parallel with the fourth polarizer 1501, the first transflective element 1502 is disposed between the fourth polarizer 1501 and the first polarization beam splitting element 1503 and the first transflective element 1502 is disposed in an inclined manner with the fourth polarizer 1501 and the first polarization beam splitting element 1503, respectively, and the first polarization beam splitting element 1503 is disposed in parallel with the first optical component 13.

The image light emitted from the image source 14 is transmitted through the fourth polarizer 1501 to obtain first image polarized light with a first polarization state, and the first image polarized light is reflected to the first polarization light splitting element 1503 through the first transflective element 1502, is reflected by the first polarization light splitting element 1503, and is transmitted to a target area through the first transflective element again to obtain target image light.

Meanwhile, the first ambient light emitted from the first optical assembly 13 is also transmitted by the first polarization beam splitter component 1503 to obtain first ambient polarized light (having a second polarization state), and the first ambient polarized light is transmitted to the target region by the first transflective component 1502 to obtain second ambient light.

For convenience of description of the second optical device 15, the structure of the first optical device 13 shown in fig. 3 is only a schematic diagram of the liquid crystal device shown in fig. 2. In actual implementation, the polarization state of the ambient light is changed by the liquid crystal element 1302, so that the light intensity of the first ambient polarized light with the second polarization state transmitted through the first polarization splitting element 1503 is changed, and finally the light intensity of the second ambient light at the target region is changed. The liquid crystal cell in fig. 3 may omit the first polarizer 1300, only the second polarizer 1301 and the liquid crystal cell 1302 remain, and the liquid crystal cell 1302 changes the light intensity of the second ambient light in the target region by changing the polarization direction of the ambient light. In addition, the liquid crystal module in fig. 3 may also be replaced by an electro-material layer, which does not change the polarization state of the ambient light, but changes the transmittance of the ambient light through the electro-material layer, so that the light intensity of the first ambient light incident to the first polarization beam splitter 1503 changes, the light intensity of the first ambient light having the second polarization state passing through the first polarization beam splitter 1503 changes, and finally the light intensity of the second ambient light in the target region changes.

Example 3

When the first optical assembly 13 includes the first polarizer 1300, the second polarizer 1301, and the liquid crystal element 1302 shown in example 1, or when the first optical assembly 13 is an electro-material layer, the second optical assembly 15 may further include a second polarization beam splitter 1601, a first 1/4 wave plate 1602, and a second semi-reflective and semi-transparent element 1603 shown in fig. 4, where the second polarization beam splitter 1601 is respectively disposed obliquely to the image source 14 and the first 1/4 wave plate 1602, the second semi-reflective and semi-transparent element 1603 is disposed parallel to the first 1/4 wave plate 1602, and the second semi-reflective and semi-transparent element 1603 is located between the first 1/4 wave plate 1601 and the first optical assembly 13.

Among the image light emitted from the image source 14, the light in the first polarization state is reflected to the first 1/4 wave plate 1602 by the second polarization beam splitter 1601 to obtain a second image polarized light (the first polarization state), the second image polarized light is reflected by the second transflective element 1603 (the fourth polarization state) after being transmitted by the first 1/4 wave plate 1602 (the third polarization state), and is transmitted by the first 1/4 wave plate 1602 to obtain a third image polarized light (the second polarization state), and the third image polarized light is transmitted to the target area by the second polarization beam splitter 1601 to obtain the target image light. Note that the third polarization state is right-handed circularly polarized light or right-handed elliptically polarized light, and the fourth polarization state is left-handed circularly polarized light or left-handed elliptically polarized light.

Meanwhile, the first ambient light (in the second polarization state) emitted from the first optical assembly 13 may sequentially transmit the second transflective element 1603, the first 1/4 wave plate 1602 and the second polarization splitting element 1601 to the target area to obtain the second ambient light.

For convenience of description of the second optical assembly 15, the structure of the first optical assembly 13 shown in fig. 4 is only a schematic diagram of the liquid crystal assembly shown in fig. 2. In practice, the polarization state of the ambient light incident on the first optical element 13 is changed by the liquid crystal element 1302, so that the light intensity of the ambient light with the second polarization state transmitted through the second transflective element 1603 is changed, and finally the light intensity of the second ambient light at the target area is changed. The liquid crystal module in fig. 4 may also be replaced by an electro-material layer, where the electro-material layer does not change the polarization state of the ambient light, and changes the transmittance of the ambient light, so that the light intensity of the first ambient light incident on the second transflective element 1603 changes, and then the light intensity of the second ambient light transmitted through the first 1/4 wave plate 1602 and the second polarization splitting element 1601 changes, and finally the light intensity of the second ambient light at the target area changes.

Further, in some implementations, in order to further filter the image light in the second polarization state and improve the optical path transmission effect of the second optical assembly 15, on the basis of the second optical assembly 15 shown in fig. 4, the second optical assembly 15 may further include a polarizer 1604 located between the image source 14 and the second polarization light splitting element 1601 as shown in fig. 5, where the polarizer 1604 is disposed in parallel with the image source 14.

In practical implementation, the image light emitted from the image source 14 passes through the polarizer 1604 to obtain the image polarized light with the first polarization state, the image polarized light passes through the second polarization beam splitter 1601 and then is reflected to the second 1/4 wave plate 1602 to obtain the second image polarized light (the first polarization state), the second image polarized light passes through the first 1/4 wave plate 1602 (the third polarization state), is reflected by the second transflective element 1603 (the fourth polarization state), and then passes through the first 1/4 wave plate 1602 to obtain the third image polarized light (the second polarization state), and the third image polarized light passes through the second polarization beam splitter 1601 and then is transmitted to the target area to obtain the target image light.

The details of the transmission optical path of the ambient light in fig. 5 are not repeated herein, and the details of the optical path shown in fig. 4 can be referred to.

Example 4

When the first optical assembly 13 includes the first polarizer 1300, the second polarizer 1301, and the liquid crystal element 1302 shown in example 1, or when the first optical assembly 13 is an electro-material layer, the second optical assembly 15 may further include a first circular polarizer 1701, a third 1/4 wave plate 1702, a fourth polarization beam splitting element 1703, and a fourth semi-transflective element 1704 shown in fig. 6, the first circular polarizer 1701 is disposed parallel to the image source 14, the third 1/4 wave plate 1702 is stacked on the fourth polarization beam splitting element 1703, the third 1/4 wave plate 1702 and the fourth polarization beam splitting element 1703 are disposed between the first circular polarizer 1701 and the fourth semi-transflective element 1704, the third 1/4 wave plate 1702 is obliquely disposed to the first circular polarizer 1701 and the fourth semi-transflective element 1704, respectively, and the fourth semi-transflective element 1704 is disposed parallel to the first optical assembly 13.

The image light emitted from the image source 14 is sequentially transmitted through the first circular polarizer 1701 and the third 1/4 wave plate 1702, and then reflected by the fourth polarization beam splitter 1703 to obtain sixth image polarized light, the sixth image polarized light is incident to the fourth transflective element 1704, and after being reflected by the fourth transflective element 1704, the sixth image polarized light sequentially transmits through the third 1/4 wave plate 1702 and the fourth polarization beam splitter 1703 to the target area to obtain the target image light.

It should be noted that, in an actual embodiment, as shown in fig. 6, the image light emitted from the image source 14 is in the third polarization state (right circularly polarized light or right elliptically polarized light) through the first circular polarizer 1701, the image light in the third polarization state is transmitted through the third 1/4 wave plate 1702 to obtain the image light in the first polarization state, the image light in the third polarization state is reflected by the fourth polarization splitting element 1703 and transmitted through the third 1/4 wave plate 1702 to obtain the image light in the third polarization state, the image light is incident toward the fourth transflective element 1704, the image light in the fourth polarization state (left circularly polarized light or left elliptically polarized light) is reflected by the fourth transflective element 1704, and then the image light in the second polarization state is transmitted through the third 1/4 wave plate 1702 to obtain the image light in the second polarization state, and the image light in the second polarization state can be transmitted through the fourth polarizing element 1703 to the target area to obtain the target image light.

In addition, the first ambient light emitted from the first optical assembly 13 sequentially transmits through the third circular polarizer 16, the fourth transflective element 1704, the third 1/4 wave plate 1702 and the fourth polarization beam splitter 1703 to the target area to obtain a second ambient light. As shown in fig. 6, the first ambient light emitted from the first optical assembly 13 transmits through the third circular polarizer 16 to obtain ambient light in a fourth polarization state (left-handed circularly polarized light or left-handed elliptically polarized light), and then transmits through the fourth transflective element 1704 and the third 1/4 wave plate 1702 to obtain ambient light in a second polarization state, and the ambient light in the second polarization state transmits through the fourth polarization beam splitting element 1703 to a target area to obtain second ambient light. By adjusting the first ambient light emitted from the first optical assembly 13, the light intensity of the second ambient light in the target area can be adjusted.

For convenience of description of the second optical device 15, the structure of the first optical device 13 shown in fig. 6 is only a schematic diagram of the liquid crystal device shown in fig. 2. When the first optical assembly 13 includes the first polarizer 1300, the second polarizer 1301, and the liquid crystal element 1302, the third circular polarizer 16 may be replaced with a 1/4 wave plate, which is similar to the above-described principle.

When the first optical element 13 is an electro-material layer, the third circular polarizer 16 may be omitted. The first ambient light sequentially transmits the fourth transflective element 1704, the third 1/4 wave plate 1702 and the fourth polarization beam splitter 1703 to obtain second ambient light in a second polarization state, and then the second ambient light is emitted to a target area. By adjusting the transmittance of the electro-material layer, the light intensity of the second ambient light in the target area can be adjusted.

Example 5

In some implementations, the second optical assembly can include a polarizing device (e.g., a polarizer or polarizing beamsplitter), and the first ambient light emitted by the first optical assembly 13 is directed to the target area via the polarizing device in the second optical assembly 15. In addition to the structure of the liquid crystal module given in the foregoing examples 1 to 4, the liquid crystal module may include a liquid crystal cell 1801 and a third polarizer 1802 shown in fig. 7, the liquid crystal cell 1801 may include a plurality of liquid crystal cells, and the liquid crystal cell 1801 is located between the third polarizer 1802 and the second optical module 15, and the liquid crystal cell 1801 is configured to arrange liquid crystal molecules in the liquid crystal cells according to a control signal applied by the controller 12 to change the light polarization direction of the liquid crystal cell. The liquid crystal module only needs to include a polarizer located outside the liquid crystal element, and the liquid crystal module is matched with the polarizer or the polarization beam splitter in the second optical module 15 to achieve the purpose of adjusting the light intensity of the second ambient light.

The polarization property of the third polarizer 1802 may be set according to the actual situations of the polarizer and the polarization splitter included in the second optical assembly 15, for example, the third polarizer 1802 may pass through the first polarization state and absorb the second polarization state, or pass through the second polarization state and absorb the first polarization state, which is not limited herein.

In addition, as to the optical path and principle of the external ambient light transmitted to the target region through the third polarizer 1802 and the liquid crystal element 1801, reference may be made to the description of the second polarizer 1301 and the liquid crystal element 1302 in example 1, and this embodiment is not described herein again.

Example 6

Referring to fig. 8 in combination with the first optical assembly 13 including the three polarizers 1802 and the liquid crystal devices 1801 shown in example 5, the second optical assembly 15 may include a third polarization beam splitting device 1901, a second 1/4 wave plate 1902, a third transflective device 1903, and a first 3/4 wave plate 1904.

Image light emitted by the image source 14 is reflected to the second 1/4 wave plate 1902 through the third polarization beam splitter 1901 to obtain fourth image polarized light (in a first polarization state), the fourth image polarized light is transmitted through the second 1/4 wave plate 1902, then is reflected by the third transflective element 1903 and is transmitted through the second 1/4 wave plate 1902 to obtain fifth image polarized light (in a second polarization state), and the fifth image polarized light is transmitted to a target area through the third polarization beam splitter 1901 to obtain target image light.

For the transmission path of the image light in the second optical component, reference may be made to the related description of fig. 4 in example 3, and details of this embodiment are not repeated herein. In addition, similarly as shown in fig. 5 in example 3, in example 6, the second optical assembly 15 may further include a polarizer located between the image source 14 and the third polarization beam splitting element 1901, and the polarizer is disposed in parallel with the image source 14 to filter out the image light in the second polarization state.

In addition, the first ambient light emitted from the first optical assembly 13 sequentially transmits the first 3/4 wave plate 1904, the third transflective element 1903, the second 1/4 wave plate 1902 and the third polarization beam splitter 1901 to the target area to obtain the second ambient light. In this example, the first ambient light after the polarization state of the liquid crystal device 1801 is twisted by the matching between the first 3/4 wave plate 1904 and the second 1/4 wave plate 1902, and the light intensity of the second ambient light incident to the target area is adjusted by the cooperation of the third polarization beam splitter 1901 in the second optical assembly 15.

Example 7

On the basis of the first optical assembly 13 comprising the three polarizer 1802 and the liquid crystal device 1801 shown in example 5, referring to fig. 9 in combination, the second optical assembly may comprise the second circular polarizer 2001, the fourth 1/4 wave plate 2002, the fifth polarization beam splitting device 2003, the fifth transflective device 2004 and the second 3/4 wave plate 2005 shown in fig. 9.

The image light emitted from the image source 14 is transmitted through the second circular polarizer 2001 and the fourth 1/4 wave plate 2002 in sequence, and then reflected by the fifth polarization beam splitting element 2003 to obtain seventh image polarized light, the seventh image polarized light enters the fifth transflective element 2004, and after being reflected by the fifth transflective element 2004, the fourth 1/4 wave plate 2002 and the fifth polarization beam splitting element 2003 are transmitted through the fifth transflective element 2004 in sequence to the target area to obtain target image light.

For the transmission path of the image light in the second optical assembly 15, reference may be made to the related description of fig. 6 in example 4, and this embodiment is not repeated herein.

In addition, the first ambient light emitted from the first optical assembly 13 sequentially transmits the second 3/4 wave plate 2005, the fifth transflective element 2004, the fourth 1/4 wave plate 2002 and the fifth polarization beam splitting element 2003 to the target area to obtain the second ambient light. In this example, the first ambient light after the polarization state is twisted by the liquid crystal element 1801 can cooperate with the fifth polarization splitting element 2003 in the second optical assembly 15 by matching the first 3/4 wave plate 2005 and the second 1/4 wave plate 2004 to adjust the light intensity of the second ambient light incident on the target area.

As can be seen from the aforementioned augmented reality device 10 provided in the present embodiment, the present disclosure has at least the following technical effects:

augmented reality device 10 can effectively solve the problem that can't carry out continuous adjustment to ambient light intensity that exists among the correlation technique, has effectively improved augmented reality device 10's display effect, has improved user's use and has experienced.

Example two

On the basis of the augmented reality device 10 in the first embodiment, the second embodiment provides a wearable augmented reality device, which may include a glasses frame and glasses legs, and the augmented reality device 10 in the first embodiment may be disposed in the glasses frame.

It should be understood that, since the augmented reality device provided in the wearable augmented reality device according to this embodiment has the same or corresponding technical features as the augmented reality device 10 provided in the first embodiment, the augmented reality device provided in the wearable augmented reality device according to this embodiment may refer to the detailed description of the augmented reality device 10 in the first embodiment, and this embodiment is not described herein again.

EXAMPLE III

As shown in fig. 10, a flowchart of a method for controlling an augmented reality device according to the present embodiment may be implemented by, but not limited to, a controller or other external control device in the augmented reality device, wherein the augmented reality device may include at least an image source, an ambient light detector, and a first optical component capable of changing a light intensity or a polarization direction of light passing through the image source, the ambient light detector, and the first optical component. The augmented reality device may further comprise a second optical component enabling the derivation of the image light emitted by the image source together with the ambient light. The method comprises at least the following steps.

And S100, generating a first control signal according to the obtained information related to the light intensity of the ambient light, wherein the information related to the light intensity of the ambient light comprises at least one of adjustment information for adjusting the light intensity of the ambient light emitted from the augmented reality device and light intensity information of the external ambient light where the augmented reality device is located, and the adjustment information is sent by the ambient light detector.

S200, applying the first control signal for changing the light intensity or the polarization direction of the ambient light passing through the first optical assembly to the first optical assembly, so that the light intensity of the emergent ambient light is attenuated to a corresponding degree compared with the light intensity of the external ambient light.

As a possible implementation, the method further includes: generating a second control signal according to the light intensity of the external environment light detected by the environment light detector; and applying the second control signal for changing the light intensity or polarization direction of the ambient light passing through the first optical assembly and changing the light intensity of the image light emitted by the image source to the image source and/or the first optical assembly so as to match the light intensity of the emergent image light of the augmented reality device with the light intensity of the emergent ambient light.

As another possible implementation, in a case that the outgoing image light defines a display area of the augmented reality device, the method may further include: applying the first control signal to the first optical assembly or applying the second control signal to the first optical assembly and/or the image source to cause the display area to be adjusted.

As yet another possible implementation, in a case where the outgoing image light defines a plurality of display regions of the augmented reality device, the method further includes: applying the first control signal to the first optical assembly, or applying the second control signal to the first optical assembly and/or the image source, so as to adjust the plurality of display areas respectively.

As another possible implementation manner, the method further includes: applying the first control signal to the first optical assembly or applying the second control signal to the first optical assembly and/or the image source to cause a transparency of a portion of the display area corresponding to an environmental object to be less than a transparency of a portion of the display area corresponding to a non-environmental object.

As yet another possible implementation, in a case where the first optical component includes a liquid crystal component or an electro-material layer, the method further includes: and applying the first control signal or the second control signal to the first optical component so as to change the arrangement direction of liquid crystal molecules in the liquid crystal component or change the optical property of the electro-material layer to change the transparency.

It should be noted that, because different implementation manners related to the method for controlling an augmented reality device in the foregoing method embodiment have the same or corresponding technical features as those of the augmented reality device, for a specific implementation process of each implementation manner, reference may be made to the detailed description of the augmented reality device, and details are not repeated here to avoid repetition. Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "...," or "comprising" does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

Claims

1. An augmented reality apparatus, comprising:

an image source for emitting image light;

a first optical assembly for receiving ambient light;

the second optical assembly is used for guiding the first ambient light emitted by the first optical assembly and the image light emitted by the image source to a target area, and the target area is an emission surface area of the second optical assembly corresponding to a maximum image display area which can be formed by the target image light emitted by the image source through the second optical assembly; the target area comprises at least one sub-area, and the sub-area is determined according to the fact that the light intensity of the image light is larger than a set threshold value;

an ambient light detector for detecting a light intensity of the ambient light;

2. The augmented reality apparatus of claim 1, wherein the controller is further configured to be connected to the image source, and to generate a second control signal for controlling the light intensity of the image light emitted from the image source and the light intensity of the first ambient light emitted from the first optical assembly according to the light intensity of the external ambient light detected by the ambient light detector, so that the light intensity of the second ambient light matches the light intensity of the target image light emitted from the image source to the target area via the second optical assembly.

3. The augmented reality device of claim 1, wherein the first optical component comprises a liquid crystal component or an electro-material layer.

4. The augmented reality device of claim 3, wherein the liquid crystal assembly comprises a first polarizer, a second polarizer, and a liquid crystal element, the liquid crystal element comprising a plurality of liquid crystal cells and being located between the first polarizer and the second polarizer, wherein the liquid crystal element is configured to align liquid crystal molecules in the liquid crystal cells according to the control signal applied by the controller to change the polarization direction of light passing through the liquid crystal element; or,

the second optical component includes a polarizing device, the liquid crystal component includes a third polarizer and a liquid crystal element including a plurality of liquid crystal cells and located between the third polarizer and the second optical component, the liquid crystal element is configured to arrange liquid crystal molecules in the liquid crystal cells according to a control signal applied by the controller to change a light polarization direction of the liquid crystal element.

5. The augmented reality device of claim 3, wherein the second optical assembly comprises a fourth polarizer, a first transflective element, and a first polarization beam splitting element;

the image light emitted by the image source is transmitted by the fourth polarizer to obtain first image polarized light, and the first image polarized light is reflected to the first polarization light splitting element by the first semi-reflecting and semi-transmitting element, is reflected by the first polarization light splitting element and is transmitted to the target area by the first semi-reflecting and semi-transmitting element;

first environment polarized light is obtained after the first environment light emitted by the first optical assembly is transmitted by the first polarization light splitting element, and the first environment polarized light is transmitted to the target area through the first transflective element.

6. The augmented reality device of claim 3 or 4, wherein when the first optical component is a liquid crystal component comprising a first polarizer, a second polarizer and a liquid crystal element, or when the first optical component is an electro-material layer, the second optical component comprises a second polarization beam splitting element, a first 1/4 wave plate and a second semi-reflective and semi-transparent element;

the image light emitted by the image source is reflected to the first 1/4 wave plate through the second polarization light splitting element to obtain second image polarized light, the second image polarized light transmits the first 1/4 wave plate, then is reflected by the second semi-reflecting and semi-transmitting element and transmits the first 1/4 wave plate to obtain third image polarized light, and the third image polarized light is transmitted to the target area through the second polarization light splitting element;

the first environment light emitted by the first optical assembly sequentially transmits the second semi-reflecting and semi-transmitting element, the first 1/4 wave plate and the second polarization light splitting element to the target area.

7. The augmented reality device of claim 4, wherein when the first optical assembly is a liquid crystal assembly and the liquid crystal assembly includes a third polarizer and a liquid crystal element, the second optical assembly includes a third polarization beam splitting element, a second 1/4 wave plate, a third transflective element and a first 3/4 wave plate;

image light emitted by the image source is reflected to the second 1/4 wave plate through the third polarization light splitting element to obtain fourth image polarized light, the fourth image polarized light transmits through the second 1/4 wave plate, then is reflected by the third semi-reflecting and semi-transmitting element and then transmits through the second 1/4 wave plate to obtain fifth image polarized light, and the fifth image polarized light is transmitted to the target area through the third polarization light splitting element;

the first ambient light emitted by the first optical assembly sequentially transmits the first 3/4 wave plate, the third semi-reflecting and semi-transmitting element, the second 1/4 wave plate and the third polarization light splitting element to the target area.

8. Augmented reality device according to claim 3 or 4, wherein when the first optical component is a liquid crystal component comprising a first polarizer, a second polarizer and a liquid crystal element, or the first optical component is an electro-material layer,

the second optical component comprises a first circular polarizer, a third 1/4 wave plate, a fourth polarization light splitting element, a fourth semi-reflecting and semi-transmitting element and a third circular polarizer;

the image light emitted by the image source is transmitted by the first circular polarizer and the third 1/4 wave plate in sequence and then reflected by the fourth polarization light splitting element to obtain sixth image polarized light, the sixth image polarized light enters the fourth semi-reflective and semi-transparent element, and after being reflected by the fourth semi-reflective and semi-transparent element, the sixth image polarized light sequentially transmits the third 1/4 wave plate and the fourth polarization light splitting element to the target area;

the first ambient light emitted by the first optical assembly sequentially transmits the third circular polarizer, the fourth semi-reflecting and semi-transmitting element, the third 1/4 wave plate and the fourth polarization beam splitting element to the target area.

9. The augmented reality device of claim 4, wherein when the first optical component is a liquid crystal component and the liquid crystal component includes a third polarizer and a liquid crystal element,

the second optical component comprises a second circular polarizer, a fourth 1/4 wave plate, a fifth polarization light splitting element, a fifth semi-reflecting and semi-transmitting element and a second 3/4 wave plate;

the image light emitted by the image source is transmitted by the second circular polarizer and the fourth 1/4 wave plate in sequence and then reflected by the fifth polarization light splitting element to obtain seventh image polarized light, the seventh image polarized light enters the fifth semi-reflective and semi-transparent element, and after being reflected by the fifth semi-reflective and semi-transparent element, the fourth 1/4 wave plate and the fifth polarization light splitting element are transmitted to the target area in sequence;

the first ambient light emitted by the first optical assembly sequentially transmits the second 3/4 wave plate, the fifth semi-reflecting and semi-transmitting element, the fourth 1/4 wave plate and the fifth polarization light splitting element to the target area.

10. Augmented reality apparatus according to claim 1,

the controller is configured to adjust the transparency of the subregion to be less than the transparency outside the subregion.

11. Augmented reality apparatus according to claim 1,

the controller is configured to adjust a transparency of a portion of the sub-region corresponding to an environmental object to be less than a transparency of a portion of the sub-region corresponding to a non-environmental object.

12. A wearable augmented reality device comprising a glasses frame and glasses legs, wherein the augmented reality device of any one of claims 1-11 is disposed in the glasses frame.

13. A method of controlling an augmented reality device, the augmented reality device comprising an image source, a controller, an ambient light detector, a first optical component and a second optical component, the first optical component being capable of changing the light intensity or polarization direction of light passing therethrough; the second optical assembly guides ambient light and image light emitted by an image source to a target area; the target area is an emergent surface area of the second optical assembly corresponding to a maximum image display area which can be formed by target image light emitted by the image source through the second optical assembly; the target area comprises at least one sub-area, and the sub-area is determined according to the fact that the light intensity of the image light is larger than a set threshold value;

the method comprises the following steps:

and adjusting the light intensity of the second environment light corresponding to each sub-area by adjusting the state of the corresponding sub-area on the first optical assembly for each sub-area, so that the light intensity of the second environment light of each sub-area is respectively matched with the light intensity of the target image light, the state of the first optical assembly corresponding to the outside of the sub-area is not adjusted, and the transparency in the boundary range of the sub-area is adjusted to be gradually increased along the direction from the inside close to the sub-area to the outside of the sub-area, wherein the boundary range of the sub-area is determined by a first set distance from the boundary of the sub-area to the inside of the sub-area and/or a second set distance from the boundary of the sub-area to the outside of the sub-area.

14. The method of controlling an augmented reality device of claim 13, further comprising:

generating a second control signal according to the light intensity of the external environment light detected by the environment light detector;

and applying the second control signal for changing the light intensity or polarization direction of the ambient light passing through the first optical assembly and changing the light intensity of the image light emitted by the image source to the image source and/or the first optical assembly so as to match the light intensity of the emergent image light of the augmented reality device with the light intensity of the emergent ambient light.

15. The method of controlling an augmented reality device of claim 14, wherein the outgoing image light defines a display region of the augmented reality device;

the method further comprises the following steps:

applying the first control signal to the first optical assembly or applying the second control signal to the first optical assembly and/or the image source to cause the display area to be adjusted.

16. The method of controlling an augmented reality device of claim 14, wherein the outgoing image light defines a plurality of display regions of the augmented reality device;

the method further comprises the following steps:

applying the first control signal to the first optical assembly, or applying the second control signal to the first optical assembly and/or the image source, so that the plurality of display areas are respectively adjusted.

17. The method of controlling an augmented reality device according to claim 15 or 16, the method further comprising:

applying the first control signal to the first optical assembly or applying the second control signal to the first optical assembly and/or the image source to cause a transparency of a portion of the display area corresponding to an environmental object to be less than a transparency of a portion of the display area corresponding to a non-environmental object.

18. The method of controlling an augmented reality device of claim 17, wherein the first optical component comprises a liquid crystal component or an electro-material layer,

the method further comprises the following steps:

and applying the first control signal or the second control signal to the first optical component to change the arrangement direction of liquid crystal molecules in the liquid crystal component or change the optical property of the electro-material layer to change the transparency.