CN111458876B

CN111458876B - Control method of head-mounted display equipment and head-mounted display equipment

Info

Publication number: CN111458876B
Application number: CN202010234521.9A
Authority: CN
Inventors: 劳逸
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-03-30
Filing date: 2020-03-30
Publication date: 2022-05-17
Anticipated expiration: 2040-03-30
Also published as: CN111458876A

Abstract

The embodiment of the application discloses a control method of a head-mounted display device and the head-mounted display device. The method comprises the following steps: and detecting the current state of the camera, and controlling the first electrochromic area to display transparent color if the current state is the use state. By implementing the embodiment of the application, the binocular vision positioning accuracy of the head-mounted display equipment can be improved.

Description

Control method of head-mounted display equipment and head-mounted display equipment

Technical Field

The present invention relates to the field of Augmented Reality (AR) technologies, and in particular, to a method for controlling a head-mounted display device and a head-mounted display device.

Background

The AR glasses are a head-mounted display device that superimposes virtual information and a real environment on the same picture in real time and performs picture display in front of the eyes of a wearer. The working principle of the AR glasses is that a plurality of real environment images are collected through a binocular camera arranged on the AR glasses, and the position and pose information of the binocular camera is obtained by performing feature matching on the plurality of real environment images based on the binocular vision positioning principle. And projecting the virtual image to a display lens in front of the binocular camera according to the spatial perspective relation indicated by the pose information, so that the impression that the real environment and the virtual image are overlapped is realized.

However, it is found in practice that the existing AR glasses are provided with protective covers for protecting the display lenses and the binocular cameras at the periphery, and when the binocular cameras are used for binocular vision positioning, the protective covers affect the binocular vision positioning, resulting in lower accuracy of the vision positioning.

Disclosure of Invention

The embodiment of the application discloses a control method of a head-mounted display device and the head-mounted display device, which can improve binocular vision positioning accuracy of the head-mounted display device.

A first aspect of an embodiment of the present application provides a method for controlling a head-mounted display device, where a first electrochromic region is disposed on a protection cover of the head-mounted display device, and the first electrochromic region is a region on the protection cover that covers a camera of the head-mounted display device; the method comprises the following steps:

detecting the current state of the camera;

and if the current state is the use state, controlling the first electrochromic area to display transparent color.

Optionally, in some embodiments of the present application, the method further includes:

if the current state is the unused state, controlling the first electrochromic area to display a target color; and the first electrochromic area shields the camera when the target color is displayed.

Optionally, in some embodiments of the present application, the detecting a current state of the camera includes:

detecting a foreground trigger event of the head-mounted display device;

if the foreground trigger event is an application switching trigger event, acquiring a target application; the application switching trigger event is used for indicating the target application to be switched to the foreground for running;

and acquiring the current state of the camera when the target application runs.

Optionally, in some embodiments of the present application, the obtaining a current state of the camera when the target application runs includes:

judging whether the target application obtains the use permission of the camera or not in operation;

if the use permission is obtained, determining the current state of the camera as the use state when the target application runs;

and if the use permission is not obtained, determining the current state of the camera when the target application runs as an unused state.

Optionally, in some embodiments of the present application, if the current state is an unused state, controlling the first electrochromic area to display a target color includes:

if the current state is the unused state, identifying the current display color of the non-shielding area as a target color; the non-shielding area is a preset area on the protective cover except the first electrochromic area;

and controlling the first electrochromic area to display the target color.

Optionally, in some embodiments of the present application, the non-blocking area is a second electrochromic area; the method further comprises the following steps:

when a color change instruction for the second electrochromic area is detected, controlling the second electrochromic area to change color to the color indicated by the color change instruction.

A first electrochromic area is arranged on a protective cover of the head-mounted display device, and the first electrochromic area is an area covering a camera of the head-mounted display device on the protective cover; the head-mounted display apparatus includes:

the detection module is used for detecting the current state of the camera;

and the control module is used for controlling the first electrochromic area to display transparent color when the current state is the use state.

Optionally, in some embodiments of the present application, the control module is further configured to control the first electrochromic area to display a target color when the current state is an unused state; and the first electrochromic area shields the camera when the target color is displayed.

A third aspect of the present application provides a head-mounted display device, where a first electrochromic region is disposed on a protective cover of the head-mounted display device, and the first electrochromic region is a region on the protective cover that covers a camera of the head-mounted display device; the head-mounted display device includes:

one or more memories;

one or more processors configured to execute one or more computer programs stored in the one or more memories, and further configured to perform the method according to the first aspect of the present application.

A fourth aspect of the present application provides a computer-readable storage medium comprising instructions which, when executed on a computer, cause the computer to perform the method according to the first aspect of the present application.

Compared with the prior art, the embodiment of the application has the following beneficial effects:

in the embodiment of the application, a first electrochromic region is arranged on a protective cover of the head-mounted display device, and the first electrochromic region is a region of the protective cover covering a camera of the head-mounted display device. It is thus clear that wear-type display device controls first electrochromic region and shows for the transparent color when using the camera for the first electrochromic region that shows for the transparent color can not shelter from the camera, can avoid carrying out binocular vision location to the camera and cause the influence, has promoted wear-type display device's binocular vision location degree of accuracy, thereby realizes better AR display effect, optimizes user's wear-type display device and uses experience.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of AR glasses disclosed in an embodiment of the present application;

fig. 2 is a flowchart illustrating a method for controlling a head-mounted display device according to an embodiment of the disclosure;

fig. 3a is a schematic view of a scene of a head-mounted display device in an embodiment of the present application when a camera is in a use state;

fig. 3b is a schematic view of a scene of a head-mounted display device in an embodiment of the present application when a camera is not in use;

fig. 4 is a flowchart illustrating another method for controlling a head-mounted display device according to an embodiment of the disclosure;

FIG. 5 is a schematic block diagram of a head mounted display device according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of another head mounted display device disclosed in the embodiments of the present application;

fig. 7 is a hardware architecture diagram of a head-mounted display device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the embodiments of the present application, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The embodiment of the application discloses a control method of a head-mounted display device and the head-mounted display device, which can improve binocular vision positioning accuracy of the head-mounted display device. Head mounted display devices may include, but are not limited to, smart glasses, head rings, and helmets, among others. It can be understood that in an implementation of this application embodiment, wear-type display device can be AR glasses, implements this application embodiment, can solve the problem that AR glasses safety cover causes the influence to binocular vision location among the background art, promotes AR glasses's binocular vision location degree of accuracy. The following detailed description is made with reference to the accompanying drawings.

In order to better understand the control method of the head-mounted display device disclosed in the embodiment of the present application, an AR glasses disclosed in the embodiment of the present application will be described below. Referring to fig. 1, fig. 1 is a schematic structural diagram of an AR glasses disclosed in an embodiment of the present application. As shown in fig. 1, the AR glasses include a frame 11, a camera 12, a protective cover 13, and a display lens 14. The spectacle frame 11 is used for fixing the AR spectacles on the head of a user, the display lenses 14 are vertically arranged on the lower portion of the front end of the spectacle frame 11, and the protective cover 13 is arranged on the outermost side far away from human eyes and can simultaneously shield the camera 12 and the display lenses 14. The first electrochromic area 131 is disposed on the protection cover 13, and the first electrochromic area 131 is an area of the protection cover 13 covering the camera 12.

In some embodiments, the frame 11 is provided with a processor that can be electrically connected to the camera 12 and the first electrochromic zone 131. The processor is configured to detect a current state of the camera 12, and input a control signal to the first electrochromic region 131, so that the first electrochromic region 131 displays a corresponding color according to the control signal.

In some embodiments, the AR glasses may further include an optical module, and a combination of the display lens 14 and the optical module may be used to implement a virtual image display. The display lens 14 may be a self-luminous active device, or may be a liquid crystal display panel illuminated by an external light source, without limitation. The optical element module can be a prism, a free-form surface, an optical waveguide element or a holographic reflective film, and is not limited. It is understood that both the display lens 14 and the optical element module can be electrically connected to and controlled by the processor.

In some embodiments, the cameras 12 may include at least one monocular camera and may also include at least one set of binocular cameras, and the specific type and number of the cameras 12 are not limited. The camera 12 may be disposed above the display lens 14 (as shown in fig. 1), or may be disposed on both sides of the display lens 14, and the specific mounting position of the camera 12 is not limited. It is understood that the number of first electrochromic zones 131 corresponds to the number of cameras 12. Taking fig. 1 as an example, in fig. 1, the two groups of cameras 12 disposed on the AR glasses are both binocular cameras, and each of the two groups of cameras 12 corresponds to one first electrochromic region 131. For ease of understanding, the following description will be made with the camera 12 being a binocular camera.

In some embodiments, the first electrochromic area 131 may be an area divided centering on a target position, which may be a position on the protection cover 13 opposite to the front of the camera 12. The size of the first electrochromic zone 131 may be greater than or equal to the size of the artificially marked zone, it being understood that the size of the artificially marked zone may be a minimum value that is marked as a standard for not affecting binocular vision positioning of the camera 12. In addition, the shape of the first electrochromic region 131 may be an ellipse (as shown in fig. 1), or may be a circle, a square, or the like, which is not particularly limited.

In some embodiments, the first electrochromic region 131 employs an electrochromic film, and particularly, the electrochromic film may be attached to an inner surface or an outer surface of the protection cover 13. The principle of electrochromism is that the electrochromism film can generate reversible color change under the action of an external voltage, so that a control signal input into the first electrochromism module can be a certain voltage value. Optionally, the electrochromic film may include multiple color-changing layers, different color-changing layers may correspond to different energization voltage values, and each color-changing layer includes an electrochromic layer. When the different color-changing layers are not electrified, the electrochromic layers are in different colors, the transparency is minimum, and the transparency of the electrochromic layers is increased along with the increase of the voltage value when the color-changing layers are electrified. For example, when a preset maximum voltage value is input to the first electrochromic region 131, the first electrochromic region 131 may be in a transparent color. Therefore, when different voltage values are input to the first electrochromic region 131, the color and transparency displayed in the first electrochromic region 131 can be flexibly adjusted.

It should be noted that the AR glasses shown in fig. 1 are all applicable to the control method of the head-mounted display device described in the following embodiments. The following describes in detail a control method for understanding a head-mounted display device disclosed in an embodiment of the present application.

Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a method for controlling a head-mounted display device according to an embodiment of the present disclosure.

201. The current state of the camera is detected.

In the embodiment of the present application, the current state of the camera may include a used state and an unused state.

As an optional implementation manner, step 201 may specifically be:

detecting a foreground trigger event of the head-mounted display device;

if the foreground trigger event is an application switching trigger event, acquiring a target application; the application switching trigger event is used for indicating that the target application is switched to the foreground of the head-mounted display device to run;

and acquiring the current state of the camera when the target application runs.

The trigger condition of the application switching trigger event may include, but is not limited to: 1. the head-mounted display device detects a user voice input for instructing the head-mounted display device to launch the target application, e.g., the user voice indicates "open target application XXX"; 2. the head-mounted display device receives an application switching instruction sent by an associated device, where the associated device is an electronic device that establishes a data communication connection with the head-mounted display device, and may specifically include a mobile phone, a tablet, a game console, and the like, without specific limitation. In addition, the application switching instruction may be an instruction generated when the associated device starts the target application, and the manner of starting the target application by the associated device includes, but is not limited to, the associated device detecting a click operation on an application icon corresponding to the target application on its touch screen, capturing a gesture for instructing starting of the target application, and the like.

That is to say, when the foreground running application of head-mounted display device changes, can trigger the state detection to the camera automatically for the state that detects again to the camera accords with the actual behavior of target application, plays the state update effect, and has guaranteed the timeliness and the accuracy that camera state detected.

Further, as an optional implementation manner, obtaining the current use state of the camera when the target application is running may specifically be:

judging whether the target application obtains the use authority of the camera or not when running;

if the use permission is obtained, determining the current use state of the camera as the use state when the target application runs; and if the use authority is not obtained, determining the current use state of the camera in the running process of the target application as an unused state.

Optionally, whether the target application obtains the use permission for the camera during running is determined, which may specifically be: acquiring an application authority table pre-stored in the head-mounted display equipment, wherein the application authority table is used for storing authorized information corresponding to all applications on the head-mounted display equipment; determining authorized information corresponding to the target application from the application permission table, and judging whether the authorized information comprises the use permission of the camera; if yes, the target application obtains the use authority in advance, and if not, the use authority is not obtained.

Optionally, if the authorized information does not include the usage right of the camera, the head-mounted display device may further output authorization query information for querying whether the user authorizes to start the camera, which includes but is not limited to: projecting an authorization query text or animation to the display lens; play the authorized inquiry voice, such as broadcast voice "Hi", do it need to start the camera. And then, detecting whether the user inputs confirmation information of the authorization inquiry information, and if so, acquiring the use authority of the camera. For example, the head-mounted display device may detect whether a user performs a preset action, such as a head nodding action of the user, through the motion sensing module, and may default to the user to input confirmation information if the preset action is detected, where the motion sensing module may include one or any combination of an acceleration sensor, a gyroscope sensor, and a magnetic sensor, and is not limited in particular.

In addition, if the user inputs the confirmation information, the use authority of the camera can be stored in the authorized information corresponding to the target application, so that the authorization inquiry of the camera does not need to be carried out again when the target application is started next time.

As another optional implementation, step 201 may specifically include: when a first body sensing action of the head-mounted display device is monitored, the current state of the camera is detected, wherein the first body sensing action can be an action of a user for taking off the head-mounted display device. The head-mounted display device can acquire sensing data (such as the distance from the sensing layer to the skin of a human body and human body pulsation data) through at least one sensing layer arranged in an area, in contact with the skin of the human body, of the head-mounted display device, and when the matching result between the acquired sensing data and the sensing data of the head-mounted display device in a wearing state is changed from matching to mismatching, it is determined that a first body sensing action is monitored. Or, the head-mounted display device may further acquire motion parameters (such as three-axis acceleration, inclination angle variation, and the like) of the head-mounted display device through the motion sensing module, and determine that the first body motion is monitored when the acquired motion parameters are matched with the motion parameters corresponding to the first body motion, which is not specifically limited.

Specifically, optionally, when monitoring a first body feeling operation on the head-mounted display device, it may further be detected whether a foreground application is currently running on the head-mounted display device, and if so, a current state of the camera when the foreground application is running may be directly obtained (specifically, reference may be made to the description of obtaining the current state of the camera when the target application is running); if not, determining the current state of the camera as an unused state.

Optionally, when the first body feeling operation on the head-mounted display device is monitored, the preset standby time may be waited, and if any response operation of the user is not monitored after the preset standby time, the current state of the camera is determined as the unused state, and the camera is controlled to be turned off, so that the power saving and energy saving effects are achieved.

In addition, as another optional implementation, step 201 may specifically be: when a second body sensing action of the head-mounted display device is monitored, detecting the current state of the camera, wherein the second body sensing action can be an action of a user wearing the head-mounted display device. The head-mounted display device can judge that the second somatosensory action is monitored when the matching result between the induction data acquired through the at least one induction layer and the induction data of the head-mounted display device in the wearing state is changed from non-matching to matching. Or, the head-mounted display device may further determine that the second body-sensory motion is monitored when the motion parameter acquired by the motion sensing module matches the motion parameter corresponding to the second body-sensory motion, which is not specifically limited.

Specifically, optionally, when a second somatosensory action on the head-mounted display device is monitored, whether a foreground application is currently running on the head-mounted display device may be detected, and if yes, a current state of the camera when the foreground application is running may be directly obtained (specifically, refer to the above description); if not, judging whether the head-mounted display equipment is provided with a self-starting application for the second body sensing action, if so, running the self-starting application, and acquiring the current state of the camera when the self-starting application runs, wherein the self-starting application can also be manually preset.

Therefore, by implementing the optional implementation mode, the state detection of the camera can be actively triggered by combining the motion sensing action of the head-mounted display equipment, and the interactivity is improved.

202. And if the current state is the use state, controlling the first electrochromic area to display transparent color.

Optionally, if the current state is the non-use state, the first electrochromic region may be controlled to display the target color, so that the camera is shielded by the first electrochromic region when the target color is displayed. Optionally, the transparency of the target color may be less than or equal to a preset threshold, and the preset threshold may correspond to the maximum transparency at which the first electrochromic region can block the camera when the target color is displayed. Therefore, when the camera is not used, the first electrochromic area displaying the target color can be used for shielding the camera.

In an optional implementation manner, the first electrochromic region includes only a single color-changing layer, the first electrochromic region in the power-on state displays a transparent color, and the first electrochromic region in the power-off state displays a target color presented by the color-changing layer, so that the first control signal for controlling the power-on of the first electrochromic region may be a power-on voltage value of the color-changing layer. Correspondingly, if the current state is the use state, whether the first electrochromic area is in the power-on state or not can be judged, and if yes, no processing is carried out; and if not, generating a first control signal, and inputting the first control signal to the first electrochromic area, so that the first electrochromic area is electrified under the action of the first control signal, and the electrified first electrochromic area is displayed in a transparent color.

If the current state is a non-use state, whether the first electrochromic area is in a power-down state or not can be judged, and if yes, no processing is carried out; if not, controlling the first electrochromic area to be powered off (for example, not inputting voltage to the first electrochromic area), so that the powered-off first electrochromic area is displayed as the target color.

In another optional implementation manner, the first electrochromic region includes at least two color-changing layers, and at this time, the first electrochromic region in the power-on state may exhibit colors and transparencies of different color-changing layers according to different input voltage values. Therefore, step 202 may specifically be: if the current state is the use state, generating a second control signal, wherein the second control signal is used for controlling the first electrochromic area to display transparent color; and controlling the first electrochromic area to display transparent color according to the second control signal.

If the current state is the unused state, generating a third control signal, wherein the third control signal is used for controlling the first electrochromic area to display the target color; and controlling the first electrochromic area to display the target color according to a third control signal.

For example, it is assumed that the first electrochromic region includes two color-changing layers, namely a red color-changing layer and a blue color-changing layer, wherein the energization voltage value of the blue color-changing layer is U₁The electrified voltage value of the red color-changing layer is U₃And U is₃＞U₁. When the voltage value indicated by the control signal belongs to 0-U₁When the color filter is used, a control signal can be input into the blue color changing layer, and the blue color changing layer is not electrified, so that the first electrochromic region is blue, and the transparency is 0%; when the voltage value belongs to U₁～U₂(U₁＜U₂＜U₃) When the first electrochromic region is in a first state, the blue color-changing layer is electrified, and the transparency of blue color displayed by the first electrochromic region is positively correlated with the voltage value until the voltage value is U₂The transparency was 100%. When the voltage value belongs to U₂～U₃When the color is changed, a control signal can be input into the red color changing layer, and the red color changing layer is not electrified, so that the first electrochromic region is red, and the transparency is 0%; when the voltage value belongs to U₃～U₄(U₃＜U₄) When the first electrochromic region is in a first state, the red color changing layer is electrified, and the transparency of red displayed by the first electrochromic region is positively correlated with the voltage value until the voltage value is U₄The transparency is 100% and the first electrochromic area appears transparent. It will thus be appreciated that the voltage value indicated by the second control signal may be U₄The third control signal may indicate 0 to U₄Compared with a single color-changing layer, the voltage value corresponding to any target color increases more optional display colors and transparency.

In this embodiment of the application, since the second control signal and the third control signal may both be voltage values, optionally, the head-mounted display device may store a target mapping relationship between the display color of the first electrochromic region and the voltage value. The display colors set by a user or a head-mounted display device when the first electrochromic region is in different states of the camera by default are obtained, and the voltage values required to be input by the first electrochromic region in the different states of the camera can be quickly obtained according to the target mapping relation. Illustratively, if it is preset that the first electrochromic area displays a transparent color when the camera is in a use state and displays a gray color when the camera is in a non-use state, then: if the current state of the camera is the use state, acquiring a corresponding voltage value when the first electrochromic area displays the transparent color according to the target mapping relation to serve as a second control signal; and if the current state of the camera is the non-use state, acquiring a corresponding voltage value when the first electrochromic area displays gray according to the target mapping relation, and using the voltage value as a third control signal.

Referring to fig. 3a and fig. 3b, fig. 3a is a schematic view of a scene of a head-mounted display device in an embodiment of the present application when a camera is in a use state, and fig. 3b is a schematic view of a scene of a head-mounted display device in an embodiment of the present application when a camera is in a non-use state. As shown in fig. 3a, taking the AR glasses shown in fig. 1 as an example, when the camera 12 is in a use state, the AR glasses control the first electrochromic region 131 to display a transparent color, so that the camera 12 can normally photograph an external environment through the first electrochromic region 131 for binocular vision positioning. As shown in fig. 3b, when the camera 12 is in the non-use state, the AR glasses control the first electrochromic region 131 to display gray such that the display color of the first electrochromic region 131 coincides with the display color of the peripheral region on the protective cover 13 (i.e., gray).

It can be seen that, by implementing the method described in fig. 2, when the head-mounted display device uses the camera, the first electrochromic region is controlled to display the transparent color, so that the first electrochromic region displaying the transparent color does not block the camera, the binocular vision positioning of the camera can be avoided from being affected, the binocular vision positioning accuracy of the head-mounted display device is improved, a better AR display effect is achieved, and the use experience of the head-mounted display device of a user is optimized.

Referring to fig. 4, fig. 4 is a schematic flowchart illustrating another method for controlling a head-mounted display device according to an embodiment of the present disclosure.

401. And detecting the current state of the camera.

402. And if the current state is the use state, controlling the first electrochromic area to display transparent color.

403. And if the current state is the unused state, identifying the current display color of the non-shielding area as a target color, wherein the non-shielding area is a preset area on the protective cover except for the first electrochromic area.

In this embodiment of the application, the area range of the preset area may be set and adjusted manually, for example, the preset area may be all areas except the first electrochromic area, or may be the remaining areas except the first electrochromic area and the display lens area, and the display lens area may be an area on the protective cover that blocks the display lens. The area range of the preset area is not particularly limited.

Therefore, when the head-mounted display device does not use the camera, the display color of the first electrochromic area can be controlled to be consistent with the display color of the non-shielding area. In addition, through the display color of comparing first electrochromic region with non-sheltering area, learn the current state of camera very easily, play the state indication effect, promptly: when the display color of the first electrochromic area is consistent with that of the non-shielding area, the camera is in a non-use state; when the display color of the first electrochromic area is inconsistent with that of the non-shielding area, the camera is in a use state.

As an alternative embodiment, the non-blocking area may be a second electrochromic area, that is, the non-blocking area may also be electrochromic using an electrochromic film. The composition and function of the second electrochromic region can refer to the description of the first electrochromic region, and are not described in detail. Correspondingly, the scheme can further comprise:

and when a color change instruction for the second electrochromic area is detected, controlling the second electrochromic area to display the color indicated by the color change instruction.

For example, the head-mounted display device may detect a color change instruction generated by the target application. For example, the target application may be a storyline interactive game application, and when the game progress of the game application progresses to a relaxed and warm storyline, the target application may generate a color change instruction instructing the second electrochromic region to display a warm color such as orange or yellow; and when the game progress of the gaming application progresses to a sad scenario, the target application may generate a color change instruction that instructs the second electrochromic region to display a cool color tone, such as blue. In addition, if the second electrochromic zone includes a display lens zone, the display color of the second electrochromic zone may also achieve different filter effects, enhancing the immersive experience for the user.

For example, the head-mounted display device may also detect a color change instruction generated according to a change in a physiological parameter of the user. For example, the head-mounted display device measures the heart rate of the user wearing the head-mounted display device through a heart rate sensor, when the heart rate of the user is low, the color change instruction generated by the head-mounted display device may indicate red, and the transparency is low at this time, such as the transparency is between 0% and 50%; the color change instructions generated by the head mounted display device may also indicate a red color when the heart rate of the user is too high, but the transparency is higher, such as between 50% and 100%. Still alternatively, for example, the head-mounted display device may further detect a color change instruction generated according to a weather condition, if the weather condition is cloudy, the head-mounted display device may generate a color change instruction for instructing the second electrochromic region to display gray, and if the weather condition is snowfall, the head-mounted display device may generate a color change instruction for instructing the second electrochromic region to display white.

Therefore, by implementing the optional embodiment, the non-shielding area supporting the electrochromic can be applied to more interactive scenes, and the entertainment and the interactivity of the head-mounted display device are increased.

Optionally, the second electrochromic region can be formed by splicing a plurality of sub-electrochromic films, the sub-electrochromic films are connected with the processor and independently controlled by the processor, and more diversified color-changing effects can be achieved.

404. And controlling the first electrochromic area to display the target color.

In the embodiment of the application, the first electrochromic area shields the camera when displaying the target color. Please refer to the description of step 201 to step 203 in the embodiment shown in fig. 2 for step 401, step 402, and step 404, which will not be described herein again.

Therefore, by implementing the method described in fig. 4, when the head-mounted display device uses the camera, the first electrochromic region is controlled to display the transparent color, so that the first electrochromic region which displays the transparent color does not shield the camera, the influence on binocular vision positioning of the camera can be avoided, and the binocular vision positioning accuracy of the head-mounted display device is improved; in addition, the camera is not used in the head-mounted display device, the display color of the first electrochromic area can be controlled to be consistent with the display color of the non-shielding area, the current state of the camera can be easily known by comparing the display colors of the first electrochromic area and the non-shielding area, and the state indication effect is achieved.

The above description is made on the control method of the head mounted display device in the embodiment of the present application, and the following description is made on the head mounted display device in the embodiment of the present application.

Referring to fig. 5, fig. 5 is a schematic block diagram of a head-mounted display device according to an embodiment of the present disclosure. The protective cover of the head-mounted display device shown in fig. 5 is provided with a first electrochromic region, and the first electrochromic region is a region of the protective cover covering the camera of the head-mounted display device. The head-mounted display device includes:

a detection module 501, configured to detect a current state of a camera;

and the control module 502 is configured to control the first electrochromic area to display a transparent color when the current state is the use state.

Optionally, in some embodiments of the present application, the control module 502 is further configured to control the first electrochromic area to display a target color when the current state is the unused state; the first electrochromic area shields the camera when displaying the target color.

Optionally, in some embodiments of the present application, the detecting module 501 is specifically configured to detect a foreground trigger event of the head-mounted display device; if the foreground trigger event is an application switching trigger event, acquiring a target application, wherein the application switching trigger event is used for indicating the target application to be switched to the foreground for operation; and acquiring the current state of the camera when the target application runs.

Further optionally, in some embodiments of the present application, a manner for the detection module 501 to obtain the current state of the camera when the target application runs may specifically be:

the detection module 501 is configured to determine whether a target application obtains a right to use a camera during running; if the use permission is obtained, determining the current state of the camera when the target application runs as the use state; and if the use authority is not obtained, determining the current state of the camera in the running process of the target application as an unused state.

Optionally, in some embodiments of the application, the control module 502 is specifically configured to, when the current state is the unused state, identify a current display color of a non-blocking area as a target color, where the non-blocking area is a preset area on the protective cover except for the first electrochromic area; and controlling the first electrochromic area to display the target color.

Further optionally, in some embodiments of the present application, the non-occluded area may be a second electrochromic area. The control module 502 may be further configured to, when a color change instruction for the second electrochromic area is detected, control the second electrochromic area to change color to a color indicated by the color change instruction.

It is thus clear that implement the wear-type display device that figure 5 described, wear-type display device controls first electrochromic region and shows for the transparent color when using the camera for the first electrochromic region that shows for the transparent color can not shelter from the camera, can avoid carrying out binocular vision location to the camera and cause the influence, has promoted wear-type display device's binocular vision location degree of accuracy, thereby realizes better AR display effect, optimizes user's wear-type display device and uses experience.

Referring to fig. 6, fig. 6 is a schematic structural diagram of another head-mounted display device disclosed in the embodiment of the present application. A first electrochromic area is arranged on a protective cover of the head-mounted display equipment, and the first electrochromic area is an area covering a camera of the head-mounted display equipment on the protective cover. The head-mounted display device includes:

one or more memories 601;

and the one or more processors 602 are configured to detect a current state of the camera and control the first electrochromic area to display a transparent color when the current state is the use state.

Optionally, in some embodiments of the present application, the one or more processors 602 are specifically configured to detect a foreground trigger event of the head mounted display device; and if the foreground trigger event is an application switching trigger event, acquiring the target application, wherein the application switching trigger event is used for indicating that the target application is switched to the foreground of the head-mounted display device to run.

Further optionally, in some embodiments of the present application, the one or more processors 602 are further configured to determine whether the target application obtains a right to use the camera during runtime; if the use permission is obtained, determining the current use state of the camera as the use state when the target application runs; and if the use authority is not obtained, determining the current use state of the camera in the running process of the target application as an unused state.

Optionally, in some embodiments of the present application, the one or more processors 602 are further configured to control the first electrochromic area to display a target color when the current state is the non-use state, so that the first electrochromic area blocks the camera when displaying the target color.

Further optionally, in some embodiments of the application, the one or more processors 602 are further configured to identify, when the current state is the unused state, a current display color of a non-blocking area as a target color, where the non-blocking area is a preset area on the protective cover except for the first electrochromic area.

Still further, in some embodiments of the present application, the non-occluded area may be a second electrochromic area, and the one or more processors 602 are further configured to, upon detecting a color change instruction for the second electrochromic area, control the second electrochromic area to change color to a color indicated by the color change instruction.

It should be noted that, for the specific implementation process of the present embodiment, reference may be made to the specific implementation process described in the above method embodiment, and a description thereof is omitted here.

Referring to fig. 7, fig. 7 is a hardware architecture diagram of a head-mounted display device according to an embodiment of the present disclosure.

The head mounted display device 700 may include a processor 710, an external memory interface 720, an internal memory 721, a Universal Serial Bus (USB) interface 730, a charging management module 740, a power management module 741, a battery 742, an antenna 1, an antenna 2, a mobile communication module 750, a wireless communication module 760, an audio module 770, a speaker 770A, a receiver 770B, a microphone 770C, an earphone interface 770D, a sensor module 780, an indicator 791, a camera 792, and a display lens 793, among others. The sensor module 780 may include a gyroscope sensor 780A, an acceleration sensor 780B, a magnetic sensor 780C, a heart rate sensor 780D, and the like.

It is to be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation to the head-mounted display device 700. In other embodiments of the present application, the head mounted display device 700 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 710 may include one or more processing units, such as: the processor 710 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.

The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 710 for storing instructions and data. In some embodiments, the memory in the processor 710 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 710. If the processor 710 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 710, thereby increasing the efficiency of the system.

In some embodiments, processor 710 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bi-directional synchronous serial bus that includes a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 710 may include multiple sets of I2C buses. The processor 710 may be coupled to the gyro sensor 780A, the charger, the flash, the camera 792, etc. through different I2C bus interfaces, respectively.

The I2S interface may be used for audio communication. In some embodiments, processor 710 may include multiple sets of I2S buses. Processor 710 may be coupled to audio module 770 via an I2S bus, enabling communication between processor 710 and audio module 770. In some embodiments, audio module 770 may pass the audio signal to processor 710 through an I2S interface so that processor 710 may perform speech recognition on the audio signal.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, audio module 770 and wireless communication module 760 may be coupled by a PCM bus interface. In some embodiments, the audio module 770 may also transmit audio signals to the wireless communication module 760 through the PCM interface, so as to receive phone calls through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 710 with the wireless communication module 760. For example: the processor 710 communicates with a bluetooth module in the wireless communication module 760 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 770 may transmit the audio signal to the wireless communication module 760 through a UART interface, so as to realize the function of playing music through a bluetooth headset.

A MIPI interface may be used to connect processor 710 with peripheral devices such as camera 792. The MIPI interface includes a Camera Serial Interface (CSI) and the like. In some embodiments, the processor 710 and the camera 792 communicate over a CSI interface to enable the capture functionality of the head mounted display device 700.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 710 with the camera 792, the display lens 793, the wireless communication module 760, the audio module 770, the sensor module 780, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

The USB interface 730 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 730 may be used to connect a charger to charge the head-mounted display device 700, and may also be used to transmit data between the head-mounted display device 700 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other electronic devices, such as AR devices and the like.

It should be understood that the connection relationship between the modules according to the embodiment of the present invention is only illustrative and does not constitute a structural limitation for the head-mounted display device 700. In other embodiments of the present application, the head-mounted display device 700 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charge management module 740 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 740 may receive charging input from a wired charger via the USB interface 730. In some wireless charging embodiments, the charging management module 740 may receive the wireless charging input through a wireless charging coil of the head mounted display device 700. While the charging management module 740 charges the battery 742, the power management module 741 may also supply power to the electronic device.

The power management module 741 is configured to connect the battery 742, the charging management module 740 and the processor 710. The power management module 741 receives input from the battery 742 and/or the charge management module 740, and provides power to the processor 710, the internal memory 721, the display 793, the camera 792, and the wireless communication module 760. The power management module 741 may also be configured to monitor parameters such as battery capacity, battery cycle count, and battery state of health (leakage, impedance). In some other embodiments, the power management module 741 may also be disposed in the processor 710. In other embodiments, the power management module 741 and the charging management module 740 may be disposed in the same device.

The wireless communication function of the head-mounted display device 700 may be implemented by the antenna 1, the antenna 2, the mobile communication module 750, the wireless communication module 760, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in head mounted display device 700 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 750 may provide a solution including 2G/3G/4G/5G and the like wireless communication applied on the head-mounted display device 700. The mobile communication module 750 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 750 can receive the electromagnetic wave from the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic wave, and transmit the processed electromagnetic wave to the modem processor for demodulation. The mobile communication module 750 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 750 may be disposed in the processor 710. In some embodiments, at least some of the functional modules of the mobile communication module 750 may be disposed in the same device as at least some of the modules of the processor 710.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 770A, the receiver 770B, etc.) or displays an image or video through the display lens 793. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be separate from the processor 710, and may be located in the same device as the mobile communication module 750 or other functional modules.

The wireless communication module 760 may provide a solution for wireless communication applied on the head-mounted display device 700, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) network), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and so on. The wireless communication module 760 may be one or more devices that integrate at least one communication processing module. The wireless communication module 760 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering on electromagnetic wave signals, and transmits the processed signals to the processor 710. The wireless communication module 760 may also receive signals to be transmitted from the processor 710, frequency modulate them, amplify them, and convert them into electromagnetic waves via the antenna 2 to radiate them.

In some embodiments, antenna 1 of the head mounted display device 700 is coupled with the mobile communication module 750 and antenna 2 is coupled with the wireless communication module 760 so that the head mounted display device 700 can communicate with networks and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The head-mounted display device 700 implements a display function through the GPU, the display lens 793, and the application processor, etc. The GPU is a microprocessor for image processing, coupled to the display optics 793 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 710 may include one or more GPUs that execute program instructions to generate or alter display information.

The head mounted display device 700 may implement a camera function through the ISP, the camera 792, the video codec, the GPU, the application processor, and the like.

The ISP is used to process the data fed back by the camera 792. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be located in the camera 792.

The camera 792 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the head mounted display device 700 may include one or N cameras 792, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the head-mounted display device 700 selects at a frequency point, the digital signal processor is used to perform fourier transform or the like on the frequency point energy.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the head-mounted display device 700 can be implemented by the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 720 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the head-mounted display device 700. The external memory card communicates with the processor 710 through the external memory interface 720 to implement data storage functions. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 721 may be used to store computer-executable program code, including instructions. The internal memory 721 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The data storage area may store data (e.g., audio data, a phone book, etc.) created during use of the head-mounted display device 700, and the like. In addition, the internal memory 721 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like. The processor 710 performs various functional applications and data processing of the head mounted display device 700 by executing instructions stored in the internal memory 721 and/or instructions stored in a memory provided in the processor.

The head mounted display device 700 may implement audio functions through the audio module 770, the speaker 770A, the microphone 770C, the earphone interface 770D, the application processor, and the like. Such as playing an authorization query voice that asks the user whether the user authorizes activation of the camera, etc.

The audio module 770 is used to convert digital audio information into an analog audio signal output and also used to convert an analog audio input into a digital audio signal. The audio module 770 may also be used to encode and decode audio signals. In some embodiments, the audio module 770 may be disposed in the processor 710, or some functional modules of the audio module 770 may be disposed in the processor 710.

The speaker 770A, also referred to as a "horn", is used to convert electrical audio signals into acoustic signals. The head mounted display device 700 may listen to music through the speaker 770A or listen to a hands-free conversation.

Receiver 770B, also referred to as a "handset," is used to convert the electrical audio signals into acoustic signals. When the head mounted display device 700 receives a call or voice information, it can receive voice by placing the receiver 770B close to the human ear.

Microphone 770C, also known as a "microphone," is used to convert acoustic signals into electrical signals. When making a call or sending voice information, the user can input a voice signal to the microphone 770C by speaking into the mouth of the user near the microphone 770C. The head mounted display device 700 may be provided with at least one microphone 770C. In other embodiments, the head-mounted display device 700 may be provided with two microphones 770C to achieve a noise reduction function in addition to collecting sound signals. In other embodiments, three, four or more microphones 770C may be further disposed on the head-mounted display device 700 to collect sound signals, reduce noise, identify sound sources, perform directional recording, and so on.

The earphone interface 770D is used to connect a wired earphone. The headset interface 770D may be the USB interface 730, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The gyro sensor 780A may be used to determine a motion pose of the head mounted display device 700. In some embodiments, the angular velocity of head mounted display device 700 about three axes (i.e., x, y, and z axes) may be determined by gyroscope sensor 780B. The gyro sensor 780B may be used to photograph anti-shake. Illustratively, when the shutter is pressed, the gyroscope 780B detects the shaking angle of the head-mounted display device 700, calculates the distance that the lens module needs to compensate according to the shaking angle, and allows the lens to counteract the shaking of the head-mounted display device 700 through a reverse motion, thereby achieving anti-shaking. The gyro sensor 780B may also be used for navigation, somatosensory gaming scenes.

The acceleration sensor 780B may detect the magnitude of acceleration of the head-mounted display device 700 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the head mounted display apparatus 700 is stationary.

The indicator 792 may be an indicator light that may be used to indicate a state of charge, a change in charge, the current state of the camera 792, or may be used to indicate a message, notification, or the like.

In an implementation of the present application, a first electrochromic region is disposed on a protective cover of the head-mounted display device 700, and the first electrochromic region is a region covering the camera 792 on the protective cover. The processor 710 is configured to detect a current state of the camera 792, and control the first electrochromic area to display a transparent color if the current state is a use state; and if the current state is the non-use state, controlling the first electrochromic area to display the target color, wherein the first electrochromic area shields the camera when the target color is displayed.

The embodiment of the application provides a computer-readable storage medium, on which computer instructions are stored, and the computer instructions can make a computer execute the control method of the head-mounted display device described in the above method embodiment.

It will be understood by those of ordinary skill in the art that all or part of the steps in the methods of the above embodiments may be performed by associated hardware instructed by a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes read-only memory (ROM), Random Access Memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically erasable rewritable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM), or other memories, CD-ROMs, or magnetic disks, A tape memory, or any other medium readable by a computer that can be used to carry or store data.

The above detailed description is provided for the control method of the head-mounted display device and the head-mounted display device disclosed in the embodiments of the present invention, and a specific example is applied in the present document to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. The control method of the head-mounted display device is characterized in that a first electrochromic region is arranged on a protective cover of the head-mounted display device, and the first electrochromic region is a region covering a camera of the head-mounted display device on the protective cover; the method comprises the following steps:

detecting a foreground trigger event of the head-mounted display device;

if the foreground trigger event is an application switching trigger event, acquiring a target application, wherein the application switching trigger event is used for indicating the target application to be switched to a foreground for operation;

acquiring the current state of the camera when the target application runs;

2. The method of claim 1, further comprising:

if the current state is the unused state, controlling the first electrochromic area to display the target color; and the first electrochromic area shields the camera when the target color is displayed.

3. The method of claim 1, wherein the obtaining the current state of the camera while the target application is running comprises:

judging whether the target application obtains the use permission of the camera or not when running;

if the use permission is obtained, determining the current state of the camera as a use state when the target application runs;

4. The method of claim 2, wherein the controlling the first electrochromic area to display the target color if the current status is the unused status comprises:

and controlling the first electrochromic area to display the target color.

5. The method of claim 4, wherein the non-occluded area is a second electrochromic area; the method further comprises the following steps:

6. The head-mounted display equipment is characterized in that a first electrochromic region is arranged on a protective cover of the head-mounted display equipment, and the first electrochromic region is a region covering a camera of the head-mounted display equipment on the protective cover; the head-mounted display apparatus includes:

the detection module is used for detecting a foreground trigger event of the head-mounted display device, acquiring a target application if the foreground trigger event is an application switching trigger event, wherein the application switching trigger event is used for indicating that the target application is switched to a foreground for running; acquiring the current state of the camera when the target application runs;

7. The head-mounted display device of claim 6, wherein the control module is further configured to control the first electrochromic region to display a target color when the current state is an unused state; and the first electrochromic area shields the camera when the target color is displayed.

8. The head-mounted display equipment is characterized in that a first electrochromic region is arranged on a protective cover of the head-mounted display equipment, and the first electrochromic region is a region covering a camera of the head-mounted display equipment on the protective cover; the head-mounted display apparatus includes:

one or more memories;

one or more processors to execute one or more computer programs stored in the one or more memories and to perform the method of any of claims 1 to 5.

9. A computer-readable storage medium comprising instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 5.