CN109739737A - Delay detection method, device and computer storage medium for head-mounted display device - Google Patents

Abstract

The embodiment of the invention provides a kind of method of testing delay, equipment and computer storage medium for wearing display equipment, method includes: to detect to wear to show whether the motion state of equipment changes；If the motion state for wearing display equipment has changed, record wears first time locating for display equipment；Whether the screen that display equipment is worn in detection changes；If the screen for wearing display equipment has changed, record wears the second time locating for display equipment；The delay time for showing equipment is worn according to obtaining at the first time with the second time.First time locating for display equipment is worn by the way that record motion state is changed；Then record screen is changed wears the second time locating for display equipment；And then by wearing the delay time for showing equipment with the second time at the first time to obtain, implementation is simple, and cost is relatively low, is also effectively guaranteed the accurate reliability of delay time acquisition.

Description

Delay detection method, device and computer storage medium for head-mounted display device

technical field

The present invention relates to the technical field of head-mounted devices, and in particular, to a delay detection method, device and computer storage medium of a head-mounted display device.

Background technique

Latency is an extremely important parameter for head-mounted display devices. Latency is defined as the time interval between when an action occurs and the content on the screen changes accordingly. It is understandable that the shorter the delay, the less likely the user experience vertigo. As a qualified head-mounted display device, the delay parameters of the device must also be given after production is completed. Therefore, how to measure the latency data of the head-mounted display device is also particularly important.

At present, a more accurate way to test the delay is to use a high-speed camera to record the time period from the motion start node to the change of the content on the screen of the head-mounted display device, so as to obtain the delay. However, the procedure of the above-mentioned delayed acquisition method is relatively cumbersome, the high-speed camera and the screen of the head-mounted display device need to be relatively fixed, and the clocks of the high-speed camera and the head-mounted display device need to be unified in order to obtain accurate results, which is difficult; and , the cost of high-speed camera testing is higher.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a delay detection method, device, and computer storage medium for a head-mounted display device, so as to reduce the complexity of the delay test, realize the delay test at low cost, and ensure the accuracy of the delay test.

In a first aspect, an embodiment of the present invention provides a delay detection method for a head-mounted display device, including:

Detect whether the motion state of the head-mounted display device has changed;

If the motion state of the head-mounted display device changes, record the first time when the head-mounted display device is located;

detecting whether the screen of the head-mounted display device has changed;

If the screen of the head-mounted display device changes, recording the second time when the head-mounted display device is located;

The delay time of the head-mounted display device is acquired according to the first time and the second time.

In a second aspect, an embodiment of the present invention provides an electronic device, including: a memory and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions are processed by the The delay detection method of the head-mounted display device in the above-mentioned first aspect is implemented when the controller is executed.

In a third aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, the computer program enables the computer to implement the method for detecting delay of a head-mounted display device in the first aspect above.

By detecting whether the motion state of the head-mounted display device changes, if the motion state of the head-mounted display device changes, the first time the head-mounted display device is in is recorded; Whether the screen changes, if the screen of the head-mounted display device changes, record the second time at which the head-mounted display device is located; and then obtain the delay time of the head-mounted display device through the first time and the second time , the implementation is simple, the cost is low, and the accuracy and reliability of delay time acquisition are also effectively ensured, thereby improving the stability and reliability of the method.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

1 is a flowchart of a method for detecting delay of a head-mounted display device according to an embodiment of the present invention;

FIG. 2 is a flowchart of detecting whether the motion state of the head-mounted display device changes according to an embodiment of the present invention;

3 is a flowchart of detecting whether the screen of the head-mounted display device has changed according to an embodiment of the present invention;

4 is a flowchart of detecting whether the screen of the head-mounted display device changes according to the initial light sensitivity value and the real-time light sensitivity value according to an embodiment of the present invention;

5 is a flowchart of acquiring the delay time of the head-mounted display device according to the first time and the second time according to an embodiment of the present invention;

6 is a flowchart of determining the average delay time of the head-mounted display device according to an embodiment of the present invention;

7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a head-mounted display device according to an embodiment of the present invention.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a," "the," and "the" as used in the embodiments of the present invention and the appended claims are intended to include the plural forms as well, unless the context clearly dictates otherwise, "a plurality" Generally, at least two kinds are included, but the case of including at least one kind is not excluded.

It should be understood that the term "and/or" used in this document is only an association relationship to describe the associated objects, indicating that there may be three kinds of relationships, for example, A and/or B, which may indicate that A exists alone, and A and B exist at the same time. B, there are three cases of B alone. In addition, the character "/" in this document generally indicates that the related objects are an "or" relationship.

Depending on the context, the words "if", "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, the phrases "if determined" or "if detected (the stated condition or event)" can be interpreted as "when determined" or "in response to determining" or "when detected (the stated condition or event)," depending on the context )" or "in response to detection (a stated condition or event)".

It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a commodity or system comprising a list of elements includes not only those elements, but also includes not explicitly listed other elements, or elements inherent to the commodity or system. Without further limitation, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the article or system that includes the element.

In addition, the sequence of steps in the following method embodiments is only an example, and is not strictly limited.

1 is a flowchart of a method for detecting delay of a head-mounted display device according to an embodiment of the present invention; with reference to FIG. 1 , this embodiment provides a method for detecting delay of a head-mounted display device, wherein the head-mounted display device is The display device may be based on Augmented Reality (AR), Virtual Reality (VR), Mixed Reality (MR; or Hybrid Reality, HR) or Cinematic Reality (CR) ) technology formed equipment. In addition, the execution body of the method may be a delay detection device, and the delay detection device may include a plurality of devices for detecting delay time. Specifically, the method may include:

S101: Detect whether the motion state of the head-mounted display device changes.

The motion state of the head-mounted display device may include a stationary state and a non-stationary state; therefore, a change in the motion state may mean that the head-mounted display device changes from a stationary state to a non-stationary state, or from a non-stationary state to a stationary state. In this embodiment, detecting whether the motion state of the head-mounted display device changes may refer to detecting whether the head-mounted display device changes from a static state to a non-static state. This embodiment does not limit the specific implementation of detecting whether the motion state of the head-mounted display device changes, and those skilled in the art can set it according to specific design requirements. Displaying whether the motion state of the device has changed can include:

S1011 : Acquire maximum posture information of the head-mounted display device when the head-mounted display device is in a stationary state and real-time posture information of the head-mounted display device by using the detection device.

Wherein, the detection device may include at least one of the following: an angular velocity sensor, a velocity sensor, an acceleration sensor, a displacement sensor, and an angle sensor. When the detection device is an angular velocity sensor, correspondingly, the obtained maximum attitude information and real-time attitude information are respectively the maximum angular velocity and real-time angular velocity; when the detection device is a speed sensor, correspondingly, the obtained maximum attitude information and real-time angular velocity are The attitude information is the maximum speed and the real-time speed respectively; when the detection device is an acceleration sensor, correspondingly, the obtained maximum attitude information and real-time attitude information are the maximum acceleration and real-time acceleration respectively; when the detection device is a displacement sensor, the corresponding The obtained maximum attitude information and real-time attitude information are respectively the maximum displacement and real-time displacement; when the detection device is an angle sensor, correspondingly, the obtained maximum attitude information and real-time attitude information are respectively the maximum angle and the real-time angle. For ease of operation, the detection device is preferably an angular velocity sensor.

In addition, in order to facilitate the acquisition of maximum attitude information and real-time attitude information and ensure the accuracy of maximum attitude information and real-time attitude information acquisition, the detection device may be fixedly/or detachably provided on the casing of the head-mounted display device. Furthermore, a plurality of real-time attitude information can be acquired by using the detection device. When using the detection device to obtain the maximum attitude information, you can first place the head-mounted display device on a stable table, and keep the head-mounted display device in a static state; at this time, run the test application pre-stored on the head-mounted display device, and statistics Multiple pieces of attitude information reported by the detection device in the stationary state. Among them, in order to ensure the accuracy and reliability of the acquisition of the maximum attitude information when the head-mounted display device is in a stationary state, the head-mounted display device can be left to be stationary for a preset time period, wherein the preset time period can be based on the application requirements of those skilled in the art. Arbitrary settings can be made. Preferably, the preset time period can be 1 min or 1.5 min, and so on. Then, within the above-mentioned preset time period, the floating range of the attitude information of the head-mounted display device when the head-mounted display device is in a static state can be determined by the obtained attitude information of a plurality of head-mounted display devices, and by comparing the various attitude information in the floating range, The maximum attitude information can be obtained, and the maximum attitude information can be used as a lower limit value of whether the state information of the head mounted display device changes.

In addition, it can be understood that the specific type of the detection device is not limited to the above-mentioned examples, and those skilled in the art can select other devices according to specific design requirements, which will not be repeated here.

S1012: If the real-time attitude information is greater than the maximum attitude information, it is determined that the motion state of the head-mounted display device has changed.

The number of real-time attitude information can be one or more. After one or more real-time attitude information is obtained, the obtained real-time attitude information can be analyzed and compared with the maximum attitude information. When a certain real-time attitude information is greater than When the maximum attitude information is present, it means that the motion state of the head-mounted display device has changed at the moment when the real-time attitude information is located, that is, from a static state to a non-static state.

S1013: If the real-time attitude information is less than or equal to the maximum attitude information, it is determined that the motion state of the head-mounted display device has not changed.

After obtaining one or more real-time attitude information, the obtained real-time attitude information can be analyzed and compared with the maximum attitude information. If all the real-time attitude information is less than or equal to the maximum attitude information, it means that the head-mounted display device has The motion state has not changed, that is, the head-mounted display device has been in a stationary state.

For example: when the detection device is an angular velocity sensor, the maximum attitude information can be 2rad/s, the first real-time attitude information can be 1rad/s, the second real-time attitude information can be 2.1rad/s, and the third real-time attitude information can be It is 1.5rad/s. It can be seen from the comparison that the first real-time attitude information 1rad/s is less than the maximum attitude information 2rad/s. Therefore, it can be determined that: when acquiring the first real-time attitude information of the head-mounted display device, the The state of motion has not changed. The second real-time attitude information 2.1 rad/s is greater than the maximum attitude information 2 rad/s. Therefore, it can be determined that the motion state of the head-mounted display device has changed when the second real-time attitude information of the head-mounted display device is obtained.

S102: If the motion state of the head-mounted display device has changed, record the first time when the head-mounted display device is located.

When the motion state of the head-mounted display device has changed, the first time that the head-mounted display device is currently in can be recorded by a preset timing device, wherein the timing device can be set on the head-mounted display device.

S103: Detect whether the screen of the head-mounted display device changes.

Among them, for the screen of the head-mounted display device, when the screen is in the initialization state, the screen is in a black state, and every time the application in the head-mounted display device refreshes the content, the screen will clear the buffer with white to make The screen changes from a black screen state to displaying a frame of white, and the screen has changed at this time, wherein the buffer stores the display content for displaying on the screen. Therefore, when detecting whether the screen of the head-mounted display device has changed, the display content on the screen of the head-mounted display device can be obtained, and whether the screen of the head-mounted display device has changed can be determined by analyzing and processing the display content. Of course, those skilled in the art can also use other ways to detect whether the screen of the head-mounted display device changes, as long as it can accurately detect whether the screen changes, which will not be repeated here.

S104: If the screen of the head-mounted display device has changed, record the second time at which the head-mounted display device is located.

When the screen of the head-mounted display device has changed, a preset timing device may be used to record the second time that the head-mounted display device is currently in.

S105: Acquire the delay time of the head-mounted display device according to the first time and the second time.

After the first time and the second time are acquired, the difference between the second time and the first time may be determined as the delay time of the head-mounted display device.

It should be noted that due to the limitations of the design and structure of the head-mounted display device, the head-mounted display device itself will also have a certain impact on the delay time. Therefore, in order to obtain the delay time of the head-mounted display device more accurately, Referring to FIG. 5 , obtaining the delay time of the head-mounted display device according to the first time and the second time may include:

S1051: Obtain the self-delay time of the head-mounted display device.

Among them, after the design of the head-mounted display device is completed, each head-mounted display device will correspond to a self-delay time, and the self-delay time may be related to the structure, model, material, etc. of the head-mounted display device. The correspondence between the display device and its own delay time can be stored in a preset storage area in advance; by obtaining the identification information of the head-mounted display device, and then using the identification information of the head-mounted display device, and by accessing the storage area, that is, The self-delay time of the headset can be obtained.

Of course, those skilled in the art can also obtain the self-delay time of the head-mounted display device in other ways, as long as the accuracy and reliability of the self-delay time acquisition can be ensured, which will not be repeated here.

S1052: Determine the delay time using the following formula: delay time=second time-first time-self delay time.

The delay detection method of the head-mounted display device provided by this embodiment detects whether the motion state of the head-mounted display device changes, and if the motion state of the head-mounted display device changes, the first time the head-mounted display device is in is recorded. ; Then detect whether the screen of the head-mounted display device changes, if the screen of the head-mounted display device changes, record the second time when the head-mounted display device is located; and then obtain the head-mounted display through the first time and the second time. The delay time of the device has a simple implementation manner and low cost, and also effectively ensures the accuracy and reliability of the delay time acquisition, thereby improving the stability and reliability of the method.

FIG. 3 is a flowchart of detecting whether the screen of the head-mounted display device changes according to an embodiment of the present invention; FIG. 4 is an embodiment of the present invention to detect whether the screen of the head-mounted display device is based on an initial light sensitivity value and a real-time light sensitivity value. The flow chart of the change; on the basis of the above-mentioned embodiment, it can be seen from the accompanying drawings 3-4 that this embodiment does not limit the specific implementation of detecting whether the screen of the head-mounted display device changes, and those skilled in the art can Set according to specific design requirements. Preferably, the detection of whether the screen of the head-mounted display device has changed in this embodiment may include:

S1031: Acquire a real-time light sensitivity value of the screen of the head-mounted display device and an initial light-sensing value of the screen of the head-mounted display device whose motion state has changed by using the light sensor.

Among them, this embodiment does not limit the specific setting position of the light sensor, and those skilled in the art can arbitrarily set it according to the functions and functions realized by the light sensor. However, considering that the brightness change of the screen does not change at the same time, it is more common , the change of screen brightness can be changed from left to right, or the change of screen brightness can also be changed from top to bottom; therefore, in order to obtain the average value of screen brightness changes as much as possible, it is preferable to The illumination sensor in this embodiment is opposite to the screen of the head-mounted display device, and the illumination sensor may be disposed at the center of the left-eye optical lens or the center of the right-eye optical lens of the head-mounted display device.

After it is determined that the motion state of the head-mounted display device has changed, an initial light-sensing value of the screen can be obtained by using the light sensor; then, multiple real-time light-sensing values of the screen of the head-mounted display device can be obtained by using the light sensor.

S1032: Detect whether the screen of the head-mounted display device changes according to the initial light sensitivity value and the real-time light sensitivity value.

Specifically, detecting whether the screen of the head-mounted display device changes according to the initial light-sensing value and the real-time light-sensing value may include:

S10321: Obtain the light sensitivity difference between the initial light sensitivity value and the real-time light sensitivity value;

The light sensitivity difference value may be the initial light sensitivity value-real-time light sensitivity value; or, the light sensitivity difference value may also be the real-time light sensitivity value-initial light sensitivity value, wherein the light sensitivity difference value may be a value greater than or equal to zero.

S10322: If the light sensitivity difference value is greater than or equal to the preset light sensitivity threshold, it is determined that the screen of the head-mounted display device has changed.

The light-sensing threshold is preset, and the specific numerical range thereof is not limited in this embodiment, and those skilled in the art can set it according to specific design requirements, which will not be repeated here. When the light sensitivity difference is greater than or equal to the preset light sensitivity threshold, it means that the screen brightness of the head-mounted display device has changed greatly, for example, from a black screen to white; therefore, it can be determined that the head-mounted display device screen has changed.

S10323: If the light sensitivity difference value is smaller than the preset light sensitivity threshold, it is determined that the screen of the head-mounted display device has not changed.

When the light sensitivity difference is less than the preset light sensitivity threshold, it means that the screen brightness of the head-mounted display device has changed slightly at this time, for example, the screen is always in a black state; therefore, it can be determined that the screen of the head-mounted display device has not changed. Variety.

The light sensitivity value of the screen of the head-mounted display device is detected by the light sensor, so as to accurately determine whether the screen of the head-mounted display device has changed. Accurate reliability of changes.

FIG. 6 is a flowchart of determining an average delay time of a head-mounted display device provided by an embodiment of the present invention; on the basis of any of the foregoing embodiments, referring to FIG. 6 , the method in this embodiment may further include:

S201: Obtain the delay time of the head-mounted display device multiple times.

The above method may be used to obtain the delay time of the head-mounted display device multiple times.

S202: Determine the average delay time of the head-mounted display device according to the delay times obtained multiple times.

After the delay time is acquired multiple times, the average of the multiple delay times may be determined as the average delay time of the head-mounted display device, thereby realizing accurate acquisition of the average delay time of the head-mounted display device.

In a specific application, this application embodiment provides a low-cost method for accurately measuring the delay of a head-mounted display device. For the convenience of description, the VR device is used as the head-mounted display device and the angular velocity sensor is used as the detection device as an example for description. In addition, it should be noted that the tools to which this method is applied may include: an Arduino development board (hereinafter referred to as a development board), an angular velocity sensor, and a light sensor, wherein the development board is respectively connected with the angular velocity sensor and the light sensor for realizing the The angular velocity sensor detects whether the motion state of the VR device changes, and the light sensor detects whether the screen of the VR device changes.

First, the maximum attitude information when the VR device is in a static attitude is obtained through statistics from the angular velocity sensor, and the maximum attitude information can be used as a criterion for judging whether the motion state of the VR equipment changes. Then, the preset Arduino program can run in the development board, the program can continuously read the real-time angular velocity obtained on the development board, and determine whether the motion state of the VR device has changed by detecting the change of the real-time angular velocity. If the motion state of the VR device changes, the current first time T1 and the initial light sensitivity value B1 are recorded. Then, it is detected whether the screen of the head-mounted display device has changed, that is, the state of the brightness change of the screen is determined. B1 is compared. If the difference between the two exceeds the light sensitivity threshold ΔB, it is considered that the screen image at this time has changed, that is, the screen is refreshed with a frame of white due to the movement of the VR device, and the current second time T2 is recorded. , through T1 and T2, and considering the delay of the VR device itself, the current delay time of the VR device can be obtained, and the delay time can be calculated periodically, and then the average delay time can be obtained.

Specifically, when obtaining the average delay time, the VR device can be placed on a desktop with less interference from external light. After the VR device is in a static position and is stable, the VR device is suddenly rotated, and then the VR device can be obtained through the above method. The delay time corresponding to this action can be printed out. After the VR device is in a static position and is stable again, the test can be repeated many times to obtain multiple delay times. By analyzing and processing the multiple delay times, the average delay time of the VR device can be obtained. The average delay time is printed out.

In this embodiment, the method and device are used to measure the delay time of the VR device, which effectively ensures the unification between the applicable device and the start-up node of the VR device, thereby effectively improving the accuracy of the delay time measurement, and the The method can be adapted to different VR devices at the same time, which effectively improves the flexibility of the method.

In a possible design, FIG. 7 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention; with reference to FIG. 7 , this embodiment provides an electronic device, which may be based on AR, VR , HMD and other equipment in the field of MR or CR. As shown in FIG. 7 , the electronic device may include: a processor 21 and a memory 22 . The memory 22 is used to store a program that supports the electronic device to execute the delay detection method of the head-mounted display device provided in the embodiments shown in FIG. 1 to FIG. 6 , and the processor 21 is configured to execute the program stored in the memory 22 . .

The program includes one or more computer instructions, wherein, when the one or more computer instructions are executed by the processor 21, the following steps can be implemented:

Detect whether the motion state of the head-mounted display device has changed;

If the motion state of the head-mounted display device has changed, record the first time when the head-mounted display device is located;

Detect whether the screen of the head-mounted display device has changed;

If the screen of the head-mounted display device has changed, recording the second time when the head-mounted display device is located;

The delay time of the head-mounted display device is acquired according to the first time and the second time.

Optionally, the processor 21 is further configured to execute all or part of the steps in the foregoing embodiments shown in FIG. 1 to FIG. 6 .

The structure of the electronic device may further include a communication interface 23 for the electronic device to communicate with other devices or a communication network.

In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions used by an electronic device, which includes a delay detection method for executing the head-mounted display device in the method embodiment shown in FIG. 1 to FIG. 6 above. the procedures involved.

It should be noted that the electronic device provided by some embodiments of the present invention may be an external head-mounted display device or an integrated head-mounted display device, wherein the external head-mounted display device needs to be used in cooperation with an external processing system (eg, a computer processing system). .

FIG. 8 is a schematic structural diagram of a head-mounted display device according to an embodiment of the present invention.

Referring to FIG. 8 , the display unit 301 may include a display panel, and the display panel is disposed on the side surface of the head-mounted display device 300 facing the face of the user, and may be a whole panel or a panel corresponding to the left eye and the right eye of the user respectively. Left and right panels. The display panel may be an electroluminescent (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a retinal direct display or similar laser scanning type display.

The virtual image optical unit 302 shows the user the image displayed by the display unit 301 in an enlarged manner, and allows the user to observe the displayed image as the enlarged virtual image. As the display image output on the display unit 301 , it may be an image of a virtual scene provided from a content reproduction device (Blu-ray disc or DVD player) or a streaming server, or an image of a real scene captured using the external camera 310 . In some embodiments, the virtual image optical unit 302 may include a lens unit, such as a spherical lens, an aspherical lens, a Fresnel lens, and the like.

The input operation unit 303 includes at least one operation component for performing input operation, such as keys, buttons, switches or other components with similar functions, receives user instructions through the operation component, and outputs the instructions to the control unit 307 .

The status information acquisition unit 304 is configured to acquire status information of a user wearing the head-mounted display device 300 . The status information acquisition unit 304 may include various types of sensors for detecting status information by itself, and may acquire status information from external devices (eg, smart phones, wrist watches, and other multifunctional terminals worn by users) through the communication unit 305 . The state information acquisition unit 304 may acquire position information and/or gesture information of the user's head. The state information acquisition unit 304 may include one or more of a gyroscope sensor, an acceleration sensor, a global positioning system (GPS) sensor, a geomagnetic sensor, a Doppler effect sensor, an infrared sensor, and a radio frequency field strength sensor. In addition, the state information acquiring unit 304 acquires state information of the user wearing the head-mounted display device 300, for example, acquiring, for example, the user's operation state (whether the user is wearing the head-mounted display device 300), the user's action state (such as still, walking, running) and the like, the posture of the hand or fingertips, the open or closed state of the eyes, the direction of the gaze, the pupil size), the mental state (whether the user is immersed in looking at the displayed image and whatnot), and even the physiological state.

The communication unit 305 performs communication processing with external devices, modulation and demodulation processing, and encoding and decoding processing of communication signals. In addition, the control unit 307 can transmit transmission data from the communication unit 305 to an external device. The communication method can be wired or wireless, such as Mobile High Definition Link (MHL) or Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), Wireless Fidelity (Wi-Fi), Bluetooth communication or Bluetooth Low Energy communication, And IEEE802.11s standard mesh network and so on. Additionally, the communication unit 305 may be a cellular wireless transceiver operating in accordance with Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and similar standards.

In some embodiments, the head mounted display device 300 may also include a storage unit, the storage unit 306 being a mass storage device configured with a solid state drive (SSD) or the like. In some embodiments, storage unit 306 may store application programs or various types of data. For example, content viewed by the user using the head mounted display device 300 may be stored in the storage unit 306 .

In some embodiments, the head mounted display device 300 may further include a control unit and a storage unit (such as the ROM 307A and RAM 307B shown in the figure), and the control unit 307 may include a computer processing unit (CPU) or other devices with similar functions. In some embodiments, the control unit 307 may be used to execute the application program stored in the storage unit 306, or the control unit 307 may also be used to execute the methods, functions and circuits of the operations disclosed in some embodiments of the present application.

The image processing unit 108 is used to perform signal processing such as image quality correction related to the image signal output from the control unit 307 and to convert its resolution into a resolution according to the screen of the display unit 301 . Then, the display driving unit 309 sequentially selects each row of pixels of the display unit 301 and sequentially scans each row of pixels of the display unit 301 row by row, thereby providing pixel signals based on the signal-processed image signals.

In some embodiments, the head mounted display device 300 may also include an external camera. The external camera 310 may be disposed on the front surface of the main body of the head-mounted display device 300 , and there may be one or more external cameras 310 . The external camera 310 can acquire three-dimensional information, and can also function as a distance sensor. Additionally, a position sensitive detector (PSD) or other type of distance sensor that detects reflected signals from objects may be used with the external camera 310 . The external camera 310 and the distance sensor may be used to detect the body position, posture and shape of the user wearing the head mounted display device 300 . In addition, under certain conditions, the user can directly watch or preview the real scene through the external camera 310 .

In some embodiments, the head mounted display device 300 may further include a sound processing unit, and the sound processing unit 311 may perform sound quality correction or sound amplification of the sound signal output from the control unit 307, and signal processing of the input sound signal. Then, the sound input/output unit 312 outputs sound to the outside and inputs sound from a microphone after sound processing.

It should be noted that the structures or components shown by the dashed box in FIG. 8 may be independent of the head-mounted display device 300, for example, may be set in an external processing system (such as a computer system) to be used in conjunction with the head-mounted display device 300; or , the structures or components shown by the dotted box may be disposed inside or on the surface of the head-mounted display device 300 .

The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.

From the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and certainly can also be implemented by combining hardware and software. Based on this understanding, the above-mentioned technical solutions can be embodied in the form of computer products in essence or that contribute to the prior art. In the form of a computer program product embodied on a medium (including but not limited to disk storage, CD-ROM, optical storage, etc.).

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable device to produce a machine such that the instructions executed by the processor of the computer or other programmable device produce a process for implementing the process. Figures a process or processes and/or block diagrams of a block or devices of the functions specified in the blocks.

The computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable device to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means that implements A function specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

These computer program instructions may also be loaded onto a computer or other programmable device such that a series of operational steps are performed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide Steps for implementing the function specified in one or more of the flowcharts and/or one or more blocks of the block diagrams.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still be The technical solutions described in the foregoing embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A delay detection method of a head-mounted display device, characterized in that, comprising: Detect whether the motion state of the head-mounted display device has changed; If the motion state of the head-mounted display device changes, record the first time when the head-mounted display device is located; detecting whether the screen of the head-mounted display device has changed; If the screen of the head-mounted display device changes, recording the second time when the head-mounted display device is located; The delay time of the head-mounted display device is acquired according to the first time and the second time. 2. The method according to claim 1, wherein the detecting whether the motion state of the head-mounted display device changes, comprising: Obtain the maximum posture information of the head-mounted display device when the head-mounted display device is in a stationary state and the real-time posture information of the head-mounted display device by using the detection device; If the real-time attitude information is greater than the maximum attitude information, it is determined that the motion state of the head-mounted display device has changed; or, If the real-time posture information is less than or equal to the maximum posture information, it is determined that the motion state of the head-mounted display device has not changed. 3. The method according to claim 2, wherein the detection device comprises at least one of the following: Angular velocity sensor, velocity sensor, acceleration sensor, displacement sensor, angle sensor. 4. The method according to claim 1, wherein detecting whether the screen of the head-mounted display device changes, comprising: Using a light sensor to acquire a real-time light sensitivity value of the screen of the head-mounted display device and an initial light-sensing value of the screen of the head-mounted display device whose motion state has changed; Whether the screen of the head-mounted display device changes is detected according to the initial light-sensing value and the real-time light-sensing value. 5. The method according to claim 4, wherein detecting whether the screen of the head-mounted display device changes according to the initial light sensitivity value and the real-time light sensitivity value, comprising: obtaining a light sensitivity difference between the initial light sensitivity value and the real-time light sensitivity value; If the light-sensing difference value is greater than or equal to a preset light-sensing threshold, it is determined that the screen of the head-mounted display device has changed; or, If the light sensitivity difference value is less than a preset light sensitivity threshold, it is determined that the screen of the head-mounted display device has not changed. 6. The method of claim 4, wherein the light sensor is opposite to a screen of the head-mounted display device, and the light sensor is disposed at the center of a left eye optical lens of the head-mounted display device or the center of the optical lens of the right eye. 7. The method according to any one of claims 1-6, wherein acquiring the delay time of the head-mounted display device according to the first time and the second time comprises: Obtain the self-delay time of the head-mounted display device; The delay time is determined using the following formula: delay time=second time-first time-self delay time. 8. The method according to claim 7, wherein the method further comprises: acquiring the delay time of the head-mounted display device multiple times; The average delay time of the head-mounted display device is determined according to the delay times acquired multiple times. 9. An electronic device, comprising: a memory and a processor; wherein the memory is used to store one or more computer instructions, wherein when the one or more computer instructions are executed by the processor A delay detection method for a head mounted display device as claimed in any one of claims 1 to 8 is implemented. 10 . A computer storage medium, characterized by being used for storing a computer program, the computer program implementing the delay detection method of the head-mounted display device according to any one of claims 1 to 8 when the computer program is executed.