CN109739737A - Wear method of testing delay, equipment and the computer storage medium of display equipment - Google Patents
Wear method of testing delay, equipment and the computer storage medium of display equipment Download PDFInfo
- Publication number
- CN109739737A CN109739737A CN201811573200.0A CN201811573200A CN109739737A CN 109739737 A CN109739737 A CN 109739737A CN 201811573200 A CN201811573200 A CN 201811573200A CN 109739737 A CN109739737 A CN 109739737A
- Authority
- CN
- China
- Prior art keywords
- head
- mounted display
- time
- display device
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010998 test method Methods 0.000 title abstract 2
- 230000033001 locomotion Effects 0.000 claims abstract description 41
- 238000001514 detection method Methods 0.000 claims abstract description 37
- 238000000034 method Methods 0.000 claims abstract description 33
- 230000035807 sensation Effects 0.000 claims description 54
- 230000003068 static effect Effects 0.000 claims description 21
- 238000004590 computer program Methods 0.000 claims description 9
- 238000005286 illumination Methods 0.000 claims description 9
- 230000003287 optical effect Effects 0.000 claims description 7
- 230000001133 acceleration Effects 0.000 claims description 6
- 238000006073 displacement reaction Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 11
- 230000008859 change Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000013461 design Methods 0.000 description 7
- 238000011161 development Methods 0.000 description 6
- 238000012360 testing method Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000005401 electroluminescence Methods 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 208000012886 Vertigo Diseases 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000011982 device technology Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000006996 mental state Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000035790 physiological processes and functions Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 231100000889 vertigo Toxicity 0.000 description 1
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The embodiment of the invention provides a kind of method of testing delay, equipment and computer storage medium for wearing display equipment, method includes: to detect to wear to show whether the motion state of equipment changes；If the motion state for wearing display equipment has changed, record wears first time locating for display equipment；Whether the screen that display equipment is worn in detection changes；If the screen for wearing display equipment has changed, record wears the second time locating for display equipment；The delay time for showing equipment is worn according to obtaining at the first time with the second time.First time locating for display equipment is worn by the way that record motion state is changed；Then record screen is changed wears the second time locating for display equipment；And then by wearing the delay time for showing equipment with the second time at the first time to obtain, implementation is simple, and cost is relatively low, is also effectively guaranteed the accurate reliability of delay time acquisition.
Description
Technical Field
The present invention relates to the field of head-mounted device technologies, and in particular, to a delay detection method and device for a head-mounted display device, and a computer storage medium.
Background
For a head-mounted display device, delay is a very important parameter, and the definition of delay is the time interval from when an action occurs to when the content on the screen changes correspondingly. It will be appreciated that the shorter the delay, the less likely the user experiences a vertigo sensation. As a qualified head-mounted display device, the delay parameters of the device must also be given after production is complete. It is also important how to measure the delay data of the head-mounted display device.
At present, the delay is accurately tested by shooting with a high-speed camera and recording the time period from the motion starting node to the time period when the content on the screen of the head-mounted display device changes, so as to obtain the delay. However, the procedure of the above-mentioned delay obtaining method is complicated, the high-speed camera and the screen of the head-mounted display device need to be relatively fixed, and the clock of the high-speed camera and the clock of the head-mounted display device need to be ensured to be uniform, so that an accurate result can be obtained, which is difficult; also, the cost of high speed camera testing is high.
Disclosure of Invention
The embodiment of the invention provides a delay detection method and device of head-mounted display equipment and a computer storage medium, which are used for reducing the complexity of delay test, realizing the delay test with low cost and ensuring the accuracy of the delay test.
In a first aspect, an embodiment of the present invention provides a delay detection method for a head-mounted display device, including:
detecting whether the motion state of the head-mounted display equipment is changed;
if the motion state of the head-mounted display equipment changes, recording the first time of the head-mounted display equipment;
detecting whether a screen of the head-mounted display device changes;
if the screen of the head-mounted display equipment is changed, recording second time of the head-mounted display equipment;
and acquiring the delay time of the head-mounted display equipment according to the first time and the second time.
In a second aspect, an embodiment of the present invention provides an electronic device, including: a memory, a processor; wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the delay detection method of the head-mounted display device in the first aspect.
In a third aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, where the computer program is used to enable a computer to execute the method for detecting the delay of the head-mounted display device in the first aspect.
Detecting whether the motion state of the head-mounted display equipment changes or not, and recording the first time of the head-mounted display equipment if the motion state of the head-mounted display equipment changes; detecting whether the screen of the head-mounted display equipment changes or not, and recording second time of the head-mounted display equipment if the screen of the head-mounted display equipment changes; and then the delay time of the head-mounted display device is acquired through the first time and the second time, so that the implementation mode is simple, the cost is low, the accuracy and the reliability of the acquisition of the delay time are effectively ensured, and the stability and the reliability of the use of the method are improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a flowchart of a delay detection method for a head-mounted display device according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a process of detecting whether a motion state of a head-mounted display device changes according to an embodiment of the present invention;
fig. 3 is a flowchart for detecting whether a screen of the head-mounted display device changes according to an embodiment of the present invention;
fig. 4 is a flowchart for detecting whether a screen of the head-mounted display device changes according to the initial light sensation value and the real-time light sensation value according to the embodiment of the invention;
fig. 5 is a flowchart for obtaining a delay time of the head-mounted display device according to the first time and the second time according to the embodiment of the present invention;
FIG. 6 is a flowchart for determining an average delay time of the head mounted display device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a head-mounted display device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, and "a" and "an" generally include at least two, but do not exclude at least one, unless the context clearly dictates otherwise.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.
In addition, the sequence of steps in each method embodiment described below is only an example and is not strictly limited.
Fig. 1 is a flowchart of a delay detection method for a head-mounted display device according to an embodiment of the present invention; referring to fig. 1, the present embodiment provides a delay detection method for a head-mounted display device, where the head-mounted display device may be a device formed based on Augmented Reality (AR), Virtual Reality (VR), Mixed Reality (MR), or Hybrid Reality (HR) or video Reality (CR) technologies. In addition, the main body of execution of the method may be a delay detection apparatus, and a plurality of devices for detecting the delay time may be included in the delay detection apparatus. Specifically, the method may include:
s101: whether the motion state of the head-mounted display device changes or not is detected.
Wherein the motion state of the head mounted display device may include a static state and a non-static state; therefore, the change of the motion state may refer to the change of the head mounted display device from a static state to a non-static state, or from a non-static state to a static state. However, detecting whether the motion state of the head mounted display device changes in the present embodiment may refer to detecting whether the head mounted display device changes from a static state to a non-static state. In this embodiment, a specific implementation manner for detecting whether the motion state of the head-mounted display device changes is not limited, and a person skilled in the art may set the detection mode according to a specific design requirement, and preferably, as shown in fig. 2, the detecting whether the motion state of the head-mounted display device changes may include:
s1011: and acquiring the maximum attitude information of the head-mounted display equipment in a static state and the real-time attitude information of the head-mounted display equipment by using the detection device.
Wherein the detection means may comprise at least one of: angular velocity sensor, acceleration sensor, displacement sensor, angle sensor. When the detection device is an angular velocity sensor, the obtained maximum attitude information and the real-time attitude information are respectively the maximum angular velocity and the real-time angular velocity correspondingly; when the detection device is a speed sensor, the obtained maximum attitude information and the real-time attitude information are respectively the maximum speed and the real-time speed correspondingly; when the detection device is an acceleration sensor, the acquired maximum attitude information and the acquired real-time attitude information are correspondingly maximum acceleration and real-time acceleration respectively; when the detection device is a displacement sensor, the obtained maximum attitude information and the real-time attitude information are correspondingly maximum displacement and real-time displacement respectively; when the detection device is an angle sensor, the obtained maximum attitude information and the real-time attitude information are respectively a maximum angle and a real-time angle correspondingly. For ease of operation, the detection means is preferably an angular velocity sensor.
In addition, in order to facilitate acquisition of the maximum posture information and the real-time posture information and to ensure accuracy of the acquisition of the maximum posture information and the real-time posture information, the detection device may be fixedly and/or detachably disposed on the housing of the head-mounted display apparatus. Further, a plurality of real-time attitude information may be acquired by the detection device. When the detection device is used for acquiring the maximum posture information, the head-mounted display equipment can be placed on a stable table top firstly, and the head-mounted display equipment is kept in a static state; at this time, the test application pre-stored in the head-mounted display device end is run, and a plurality of posture information reported by the detection device in the static state is counted. In order to ensure the accuracy and reliability of obtaining the maximum posture information when the head-mounted display device is in a static state, the head-mounted display device may be allowed to stand for a preset time period, where the preset time period may be arbitrarily set according to application requirements of those skilled in the art, and is preferably 1min or 1.5 min or the like. And then in the preset time period, the floating range of the posture information of the head-mounted display device in the static state can be determined through the acquired posture information of the plurality of head-mounted display devices, and the maximum posture information can be acquired through comparing the posture information in the floating range, and can be used as a lower limit value for judging whether the state information of the head-mounted display device changes or not.
In addition, it is understood that the specific type of the detecting device is not limited to the above-mentioned examples, and those skilled in the art may select other devices according to specific design requirements, which are not described herein again.
S1012: and if the real-time attitude information is larger than the maximum attitude information, determining that the motion state of the head-mounted display equipment has changed.
The number of the real-time posture information can be one or more, after the one or more real-time posture information are acquired, the acquired real-time posture information can be analyzed and compared with the maximum posture information, and when a certain real-time posture information is larger than the maximum posture information, the fact that the motion state of the head-mounted display device changes at the moment of the real-time posture information indicates that the motion state of the head-mounted display device changes from a static state to a non-static state is shown.
S1013: and if the real-time attitude information is less than or equal to the maximum attitude information, determining that the motion state of the head-mounted display equipment is not changed.
After one or more pieces of real-time posture information are acquired, the acquired real-time posture information and the maximum posture information can be analyzed and compared, and if all pieces of real-time posture information are smaller than or equal to the maximum posture information, it is indicated that the motion state of the head-mounted display device is not changed, that is, the head-mounted display device is in a static state all the time.
For example: when the detection device is an angular velocity sensor, the maximum attitude information may be 2rad/s, the first real-time attitude information may be 1rad/s, the second real-time attitude information may be 2.1rad/s, and the third real-time attitude information may be 1.5rad/s, and as can be seen by comparison, the first real-time attitude information 1rad/s is smaller than the maximum attitude information 2rad/s, and therefore, it can be determined that: when the first real-time posture information of the head-mounted display device is acquired, the motion state of the head-mounted display device is unchanged. And the second real-time attitude information 2.1rad/s is greater than the maximum attitude information 2rad/s, so that it can be determined that the motion state of the head-mounted display device has changed when the second real-time attitude information of the head-mounted display device is acquired.
S102: if the motion state of the head-mounted display device has changed, recording a first time at which the head-mounted display device is located.
When the motion state of the head-mounted display device has changed, a first time at which the head-mounted display device is currently located may be recorded by a preset timing device, where the timing device may be disposed on the head-mounted display device.
S103: whether a screen of the head-mounted display device changes or not is detected.
The method includes the steps that for a screen of the head-mounted display device, when the screen is in an initialization state, the screen is in a black screen state, and when an application in the head-mounted display device refreshes contents each time, the screen clears a buffer area with white, so that the screen is changed from the black screen state to display a frame of white, and the screen is changed at the moment, wherein the display contents for displaying on the screen are stored in the buffer area. Therefore, when detecting whether the screen of the head-mounted display device changes, the display content on the screen in the head-mounted display device can be acquired, and whether the screen of the head-mounted display device changes is judged through analysis processing of the display content. Of course, a person skilled in the art may also use other methods to detect whether the screen of the head-mounted display device changes, as long as whether the screen changes can be accurately detected, which is not described herein again.
S104: and if the screen of the head-mounted display device is changed, recording a second time of the head-mounted display device.
When the screen of the head-mounted display device is changed, the second time at which the head-mounted display device is currently located can be recorded through a preset timing device.
S105: and acquiring the delay time of the head-mounted display device according to the first time and the second time.
After the first time and the second time are acquired, a difference between the second time and the first time may be determined as a delay time of the head mounted display device.
It should be noted that, due to the limitation of the design, structure and other factors of the head-mounted display device, the delay time of the head-mounted display device itself may also have a certain influence, and therefore, in order to more accurately acquire the delay time of the head-mounted display device, referring to fig. 5, the acquiring the delay time of the head-mounted display device according to the first time and the second time may include:
s1051: the self-delay time of the head-mounted display device is acquired.
After the design of the head-mounted display device is finished, each head-mounted display device corresponds to a self delay time, the self delay time can be related to the structure, model, material and the like of the head-mounted display device, and the corresponding relation between the head-mounted display device and the self delay time can be stored in a preset storage area in advance; the self delay time of the head-mounted display equipment can be acquired by acquiring the identity identification information of the head-mounted display equipment, then utilizing the identity identification information of the head-mounted display equipment and accessing the storage area.
Of course, those skilled in the art may also use other methods to obtain the self delay time of the head-mounted display device, as long as the accuracy and reliability of obtaining the self delay time can be ensured, which is not described herein again.
S1052: the delay time is determined using the following equation: the delay time is the second time, the first time, and the self delay time.
In the delay detection method for the head-mounted display device provided by this embodiment, by detecting whether the motion state of the head-mounted display device changes, if the motion state of the head-mounted display device changes, the first time at which the head-mounted display device is located is recorded; then detecting whether the screen of the head-mounted display equipment changes or not, and recording second time of the head-mounted display equipment if the screen of the head-mounted display equipment changes; and then the delay time of the head-mounted display device is acquired through the first time and the second time, so that the implementation mode is simple, the cost is low, the accuracy and the reliability of the acquisition of the delay time are effectively ensured, and the stability and the reliability of the use of the method are improved.
Fig. 3 is a flowchart illustrating detecting whether a screen of a head-mounted display device changes according to an embodiment of the present invention; fig. 4 is a flowchart illustrating a process of detecting whether a screen of a head-mounted display device changes according to an initial light sensation value and a real-time light sensation value according to an embodiment of the invention; on the basis of the foregoing embodiment, with reference to fig. 3 to 4, it can be seen that in this embodiment, a specific implementation manner for detecting whether a screen of the head-mounted display device changes is not limited, and a person skilled in the art may set the detection according to a specific design requirement, and preferably, the detecting whether the screen of the head-mounted display device changes in this embodiment may include:
s1031: the real-time light sensation value of the screen of the head-mounted display device and the initial light sensation value of the screen of the head-mounted display device with the changed motion state are obtained by the light sensor.
In this embodiment, the specific setting position of the illumination sensor is not limited, and a person skilled in the art can set the illumination sensor at will according to the function realized by the illumination sensor, however, considering that the brightness changes of the screen do not change simultaneously, which is common, the brightness changes of the screen can change from the left side to the right side, or the brightness changes of the screen can also change from the upper side to the lower side; therefore, in order to obtain the average value of the screen brightness variation as much as possible, it is preferable that the illumination sensor in the present embodiment is opposite to the screen of the head-mounted display device, and the illumination sensor may be disposed at the center of the left-eye optical lens or the center of the right-eye optical lens of the head-mounted display device.
After determining that the motion state of the head-mounted display device has changed, acquiring an initial light sensation value of the screen by using the light sensor; then, a plurality of real-time light sensation values of the screen of the head-mounted display device may be acquired using the illumination sensor.
S1032: and detecting whether the screen of the head-mounted display equipment changes or not according to the initial light sensation value and the real-time light sensation value.
Specifically, detecting whether the screen of the head-mounted display device changes according to the initial light sensation value and the real-time light sensation value may include:
s10321: acquiring a light sensation difference value between the initial light sensation value and the real-time light sensation value;
the light sensation difference value can be an initial light sensation value-a real-time light sensation value; alternatively, the light sensation difference value may be a real-time light sensation value-an initial light sensation value, wherein the light sensation difference value may be a value greater than or equal to zero.
S10322: and if the light sensation difference value is larger than or equal to the preset light sensation threshold value, determining that the screen of the head-mounted display device is changed.
The light sensation threshold is preset, and the specific numerical range is not limited in this embodiment, and those skilled in the art can set the light sensation threshold according to specific design requirements, which is not described herein again. When the light sensation difference value is greater than or equal to the preset light sensation threshold value, it indicates that the screen brightness of the head-mounted display device is greatly changed, for example: changing from a black screen state to white; accordingly, it can be determined that the screen of the head mounted display device has changed.
S10323: and if the light sensation difference value is smaller than the preset light sensation threshold value, determining that the screen of the head-mounted display device is not changed.
When the light sensation difference value is smaller than the preset light sensation threshold value, it indicates that the screen brightness of the head-mounted display device is slightly changed, for example: the screen is always in a black screen state; accordingly, it can be determined that the screen of the head mounted display device has not changed.
The light sensation value of the screen of the head-mounted display device is detected through the illumination sensor, so that whether the screen of the head-mounted display device changes or not can be accurately judged, the implementation mode is simple, and the accuracy and reliability of whether the screen of the head-mounted display device changes or not are effectively guaranteed.
FIG. 6 is a flowchart of determining an average delay time of a head mounted display device according to an embodiment of the present invention; on the basis of any one of the above embodiments, referring to fig. 6, the method in this embodiment may further include:
s201: the delay time of the head mounted display device is acquired a plurality of times.
The delay time of the head-mounted display device may be acquired multiple times using the above-described method.
S202: and determining the average delay time of the head-mounted display equipment according to the delay times acquired for multiple times.
After the delay time is acquired for a plurality of times, the average value of the delay time can be determined as the average delay time of the head-mounted display device, so that the accurate acquisition of the average delay time of the head-mounted display device is realized.
In a specific application, the present application embodiment provides a method for accurately measuring the delay of the head-mounted display device at low cost, and for convenience of description, a VR device is taken as the head-mounted display device, and an angular velocity sensor is taken as a detection apparatus for example. In addition, it should be noted that the tool to which the method is applied may include: arduino development board (hereinafter referred to as development board), angular velocity sensor, light sensor, wherein, the development board is connected with angular velocity sensor and light sensor respectively for whether the motion state that realizes detecting VR equipment through angular velocity sensor changes, whether the screen that detects VR equipment through light sensor changes.
Firstly, the maximum attitude information of the VR device in a static attitude is obtained through the statistics of the angular velocity sensor, and the maximum attitude information can be used as a judgment standard for judging whether the motion state of the VR device changes or not. Then, the predetermined Arduino procedure can be run in the development board, and this procedure can constantly read the real-time angular velocity who acquires on the development board, through the change that detects real-time angular velocity, judges whether the motion state of VR equipment changes. If the motion state of the VR device changes, the current first time T1 and the initial light sensation value B1 are recorded. And then detecting whether the screen of the head-mounted display device changes, namely judging the state of the brightness change of the screen, wherein the program can continuously read a real-time light sensation value B2 acquired on a development board, comparing the real-time light sensation value B2 with an initial light sensation value B1, if the difference value of the real-time light sensation value B2 and the initial light sensation value B1 exceeds a light sensation threshold value delta B, determining that the screen picture at the moment changes, namely, the screen refreshes a frame of white due to the movement of the VR device, recording the current second time T2, and taking the delay of the VR device into consideration through T1 and T2, so that the current delay time of the VR device can be obtained, and the average delay time can be obtained by periodically counting the delay time.
Specifically, when obtaining average delay time, can put VR equipment on the less desktop of external light interference, treat that VR equipment is in static gesture and steady back, rotate VR equipment suddenly, then can obtain the delay time that VR equipment corresponds based on this time action through above-mentioned mode to can carry out printout with this delay time. After the VR equipment is in the static posture again and is stable, repeated testing can be carried out for many times, so that delay time can be obtained for many times, the average delay time of the VR equipment can be obtained by analyzing and processing the delay time for many times, and then the average delay time can be printed and output.
The embodiment measures the delay time of the VR equipment through the method and the equipment, effectively ensures the unification between the equipment which can be applied and the starting node of the VR equipment, thereby effectively improving the accuracy of the measurement of the delay time.
In one possible design, fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention; referring to fig. 7, the present embodiment provides an electronic device, which may be an HMD or the like based on AR, VR, MR or CR fields. As shown in fig. 7, the electronic device may include: a processor 21 and a memory 22. Wherein the memory 22 is used for storing a program for supporting the electronic device to execute the delay detection method of the head mounted display device provided in the embodiments shown in fig. 1-6, and the processor 21 is configured for executing the program stored in the memory 22.
The program comprises one or more computer instructions which, when executed by the processor 21, are capable of performing the steps of:
detecting whether the motion state of the head-mounted display equipment is changed;
if the motion state of the head-mounted display equipment is changed, recording the first time of the head-mounted display equipment;
detecting whether a screen of the head-mounted display device changes;
if the screen of the head-mounted display device is changed, recording second time of the head-mounted display device;
and acquiring the delay time of the head-mounted display device according to the first time and the second time.
Optionally, the processor 21 is further configured to perform all or part of the steps in the embodiments of fig. 1-6.
The electronic device may further include a communication interface 23 for communicating with other devices or a communication network.
In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions for an electronic device, which includes a program for executing the delay detection method of the head-mounted display device in the method embodiments shown in fig. 1 to 6.
It should be noted that the electronic device provided by some embodiments of the present invention may be an external head-mounted display device or an integrated head-mounted display device, where the external head-mounted display device needs to cooperate with an external processing system (e.g., a computer processing system).
Fig. 8 is a schematic structural diagram of a head-mounted display device according to an embodiment of the present invention.
Referring to fig. 8, the display unit 301 may include a display panel disposed on a side surface of the head-mounted display device 300 facing the face of the user, which may be a single panel or a left panel and a right panel corresponding to the left eye and the right eye of the user, respectively. The display panel may be an Electroluminescence (EL) element, a liquid crystal display or a micro display having a similar structure, or a laser scanning type display in which the retina can directly display or the like.
The virtual image optical unit 302 presents the image displayed by the display unit 301 to the user in an enlarged manner, and allows the user to observe the displayed image as the enlarged virtual image. As the display image output onto the display unit 301, an image of a virtual scene provided from a content reproduction apparatus (blu-ray disc or DVD player) or a streaming server, or an image of a real scene photographed using the external camera 310 may be possible. In some embodiments, the virtual image optics unit 302 may include a lens unit, such as a spherical lens, an aspherical lens, a fresnel lens, or the like.
The input operation unit 303 includes at least one operation section such as a key, a button, a switch, or other like section having a similar function for performing an input operation, receives a user instruction through the operation section, and outputs the instruction to the control unit 307.
The status information acquisition unit 304 is used to acquire status information of a user wearing the head-mounted display device 300. The state information acquisition unit 304 may include various types of sensors for detecting state information by itself, and may acquire the state information from an external device (e.g., a smartphone, a wristwatch, and other multi-function terminal worn by the user) through the communication unit 305. The state information acquisition unit 304 may acquire position information and/or posture information of the head of the user. The state information acquisition unit 304 may include one or more of a gyro sensor, an acceleration sensor, a Global Positioning System (GPS) sensor, a geomagnetic sensor, a doppler effect sensor, an infrared sensor, and a radio frequency field intensity sensor. Further, the state information acquisition unit 304 acquires state information of the user wearing the head mounted display device 300, for example, acquires, for example, an operation state of the user (whether the user is wearing the head mounted display device 300), an action state of the user (a moving state such as still, walking, running, and the like, a posture of a hand or a fingertip, an open or closed state of an eye, a line of sight direction, a pupil size), a mental state (whether the user is immersed in viewing a displayed image, and the like), and even a physiological state.
The communication unit 305 performs communication processing with an external device, modulation and demodulation processing, and encoding and decoding processing of a communication signal. In addition, the control unit 307 can transmit transmission data from the communication unit 305 to an external device. The communication means may be in a wired or wireless form, such as mobile high definition link (MHL) or Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), wireless fidelity (Wi-Fi), bluetooth communication or bluetooth low energy communication, and mesh network of ieee802.11s standard, etc. Additionally, the communication unit 305 may be a cellular radio transceiver operating in accordance with wideband code division multiple access (W-CDMA), Long Term Evolution (LTE), and similar standards.
In some embodiments, the head mounted display device 300 may further include a storage unit, and the storage unit 306 is a mass storage device configured with a Solid State Drive (SSD) or the like. In some embodiments, the storage unit 306 may store applications or various types of data. For example, content viewed by a user using head mounted display device 300 may be stored in storage unit 306.
In some embodiments, the head-mounted display device 300 may further include a control unit and a storage unit (e.g., ROM 307A and RAM 307B as shown), and the control unit 307 may include a Computer Processing Unit (CPU) or other device with similar functionality. In some embodiments, the control unit 307 may be used to execute applications stored by the storage unit 306, or the control unit 307 may also be used to execute circuitry that performs the methods, functions, and operations disclosed in some embodiments of the present application.
The image processing unit 108 is used to perform signal processing such as image quality correction related to the image signal output from the control unit 307 and convert the resolution thereof into a resolution according to the screen of the display unit 301. Then, the display driving unit 309 sequentially selects each row of pixels of the display unit 301 and sequentially scans each row of pixels of the display unit 301 row by row, thereby providing pixel signals based on the signal-processed image signals.
In some embodiments, head mounted display device 300 may also include an external camera. The external camera 310 may be disposed on a front surface of the body of the head mounted display device 300, and the external camera 310 may be one or more. The external camera 310 may acquire three-dimensional information and may also function as a distance sensor. Additionally, a Position Sensitive Detector (PSD) or other type of distance sensor that detects reflected signals from objects may be used with the external camera 310. The external camera 310 and the distance sensor may be used to detect the body position, posture and shape of the user wearing the head-mounted display device 300. In addition, the user may directly view or preview the real scene through the external camera 310 under certain conditions.
In some embodiments, the head-mounted display device 300 may further include a sound processing unit, and the sound processing unit 311 may perform sound quality correction or sound amplification of the sound signal output from the control unit 307, signal processing of the input sound signal, and the like. Then, the sound input/output unit 312 outputs sound to the outside and inputs sound from the microphone after sound processing.
It should be noted that the structure or components shown in the dashed box in fig. 8 may be independent from the head-mounted display device 300, and may be disposed in an external processing system (e.g., a computer system) for use with the head-mounted display device 300; alternatively, the structures or components shown in dashed line boxes may be disposed within or on the surface of the head mounted display device 300.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course, can also be implemented by a combination of hardware and software. With this understanding in mind, the above-described aspects and portions of the present technology which contribute substantially or in part to the prior art may be embodied in the form of a computer program product, which may be embodied on one or more computer-usable storage media having computer-usable program code embodied therein, including without limitation disk storage, CD-ROM, optical storage, and the like.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A delay detection method of a head-mounted display device, comprising:
detecting whether the motion state of the head-mounted display equipment is changed;
if the motion state of the head-mounted display equipment changes, recording the first time of the head-mounted display equipment;
detecting whether a screen of the head-mounted display device changes;
if the screen of the head-mounted display equipment is changed, recording second time of the head-mounted display equipment;
and acquiring the delay time of the head-mounted display equipment according to the first time and the second time.
2. The method of claim 1, wherein the detecting whether the motion state of the head mounted display device changes comprises:
acquiring the maximum attitude information of the head-mounted display equipment in a static state and the real-time attitude information of the head-mounted display equipment by using a detection device;
if the real-time attitude information is greater than the maximum attitude information, determining that the motion state of the head-mounted display device has changed; or,
and if the real-time posture information is less than or equal to the maximum posture information, determining that the motion state of the head-mounted display equipment is not changed.
3. The method of claim 2, wherein the detection device comprises at least one of:
angular velocity sensor, acceleration sensor, displacement sensor, angle sensor.
4. The method of claim 1, wherein detecting whether a screen of the head-mounted display device changes comprises:
acquiring a real-time light sensation value of a screen of the head-mounted display device and an initial light sensation value of the screen of the head-mounted display device with a changed motion state by using a light sensor;
and detecting whether the screen of the head-mounted display equipment changes or not according to the initial light sensation value and the real-time light sensation value.
5. The method of claim 4, wherein detecting whether a screen of the head-mounted display device changes according to the initial light sensation value and the real-time light sensation value comprises:
acquiring a light sensation difference value between the initial light sensation value and the real-time light sensation value;
if the light sensation difference value is larger than or equal to a preset light sensation threshold value, determining that the screen of the head-mounted display device is changed; or,
and if the light sensation difference value is smaller than a preset light sensation threshold value, determining that the screen of the head-mounted display equipment is not changed.
6. The method of claim 4, wherein the illumination sensor is opposite a screen of the head mounted display device, and wherein the illumination sensor is disposed at a center of a left eye optical lens or a center of a right eye optical lens of the head mounted display device.
7. The method according to any one of claims 1-6, wherein obtaining the delay time of the head mounted display device according to the first time and the second time comprises:
acquiring self delay time of the head-mounted display equipment;
determining the delay time using the following equation: the delay time is the second time, the first time, and the self delay time.
8. The method of claim 7, further comprising:
obtaining delay time of the head-mounted display device for a plurality of times;
determining an average delay time of the head-mounted display device according to the delay times acquired multiple times.
9. An electronic device, comprising: a memory, a processor; wherein the memory is to store one or more computer instructions that when executed by the processor implement a latency detection method for a head mounted display device according to any one of claims 1 to 8.
10. A computer storage medium storing a computer program for causing a computer to execute a delay detection method of a head-mounted display device according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811573200.0A CN109739737A (en) | 2018-12-21 | 2018-12-21 | Wear method of testing delay, equipment and the computer storage medium of display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811573200.0A CN109739737A (en) | 2018-12-21 | 2018-12-21 | Wear method of testing delay, equipment and the computer storage medium of display equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109739737A true CN109739737A (en) | 2019-05-10 |
Family
ID=66359493
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811573200.0A Pending CN109739737A (en) | 2018-12-21 | 2018-12-21 | Wear method of testing delay, equipment and the computer storage medium of display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109739737A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111162859A (en) * | 2019-11-29 | 2020-05-15 | 青岛小鸟看看科技有限公司 | Time synchronization method and device of head-mounted display system and head-mounted display system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110075582A1 (en) * | 2009-09-25 | 2011-03-31 | Fujitsu Limited | Delay time measurement apparatus, storage medium storing delay time measurement program and network system |
| WO2015141173A1 (en) * | 2014-03-17 | 2015-09-24 | セイコーエプソン株式会社 | Movement analysis method, movement analysis device, movement analysis system and program |
| CN105807601A (en) * | 2016-03-10 | 2016-07-27 | 北京小鸟看看科技有限公司 | Method and system for testing virtual reality equipment delay |
| CN106441810A (en) * | 2016-12-16 | 2017-02-22 | 捷开通讯(深圳)有限公司 | Device and method for detecting delay time of VR (virtual reality) equipment |
| CN108415799A (en) * | 2018-02-11 | 2018-08-17 | 深圳创维新世界科技有限公司 | Delay measurement system |
| CN108427612A (en) * | 2018-02-11 | 2018-08-21 | 深圳创维新世界科技有限公司 | Time delay measurement method |
| CN108446192A (en) * | 2018-02-11 | 2018-08-24 | 深圳创维新世界科技有限公司 | Time delay measurement equipment |
-
2018
- 2018-12-21 CN CN201811573200.0A patent/CN109739737A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110075582A1 (en) * | 2009-09-25 | 2011-03-31 | Fujitsu Limited | Delay time measurement apparatus, storage medium storing delay time measurement program and network system |
| WO2015141173A1 (en) * | 2014-03-17 | 2015-09-24 | セイコーエプソン株式会社 | Movement analysis method, movement analysis device, movement analysis system and program |
| CN105807601A (en) * | 2016-03-10 | 2016-07-27 | 北京小鸟看看科技有限公司 | Method and system for testing virtual reality equipment delay |
| CN106441810A (en) * | 2016-12-16 | 2017-02-22 | 捷开通讯(深圳)有限公司 | Device and method for detecting delay time of VR (virtual reality) equipment |
| CN108415799A (en) * | 2018-02-11 | 2018-08-17 | 深圳创维新世界科技有限公司 | Delay measurement system |
| CN108427612A (en) * | 2018-02-11 | 2018-08-21 | 深圳创维新世界科技有限公司 | Time delay measurement method |
| CN108446192A (en) * | 2018-02-11 | 2018-08-24 | 深圳创维新世界科技有限公司 | Time delay measurement equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111162859A (en) * | 2019-11-29 | 2020-05-15 | 青岛小鸟看看科技有限公司 | Time synchronization method and device of head-mounted display system and head-mounted display system |
| CN111162859B (en) * | 2019-11-29 | 2022-06-14 | 青岛小鸟看看科技有限公司 | Time synchronization method and device of head-mounted display system and head-mounted display system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10732707B2 (en) | Perception based predictive tracking for head mounted displays | |
| CN109557669B (en) | Method for determining image drift amount of head-mounted display equipment and head-mounted display equipment | |
| CN108762492B (en) | Method, device and equipment for realizing information processing based on virtual scene and storage medium | |
| EP3419024B1 (en) | Electronic device for providing property information of external light source for interest object | |
| JP6246829B2 (en) | Resource management for head mounted display | |
| CN106716303B (en) | Stablize the movement of interaction ray | |
| US20240267650A1 (en) | Depth based dynamic vision sensor | |
| US11809613B2 (en) | Event-based camera with high-resolution frame output | |
| US20240137664A1 (en) | Patch tracking image sensor | |
| WO2017092332A1 (en) | Method and device for image rendering processing | |
| CN109002164A (en) | It wears the display methods for showing equipment, device and wears display equipment | |
| WO2018223663A1 (en) | Vr image processing method, device, and apparatus | |
| US20210096388A1 (en) | Automated video capture and composition system | |
| US20210132378A1 (en) | Head mounted display and information processing method | |
| WO2019015249A1 (en) | Virtual-reality-based image display method and apparatus, and virtual reality helmet device | |
| CN109997171A (en) | Display device and program | |
| US20180129277A1 (en) | Method, virtual reality apparatus and recording medium for fast moving in virtual reality | |
| CN109739737A (en) | Wear method of testing delay, equipment and the computer storage medium of display equipment | |
| US10257427B2 (en) | Information processing method and electronic device | |
| CN109696959B (en) | Picture display method, equipment and storage medium | |
| US20210278665A1 (en) | Electronic device and control method thereof | |
| US20180150134A1 (en) | Method and apparatus for predicting eye position | |
| US11422622B2 (en) | Electronic device and operating method thereof | |
| CN107844197A (en) | Virtual reality scenario display methods and equipment | |
| EP3695622B1 (en) | Adaptation of presentation speed |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201116 Address after: 261061 north of Yuqing East Street, east of Dongming Road, Weifang High tech Zone, Weifang City, Shandong Province (Room 502, Geer electronic office building) Applicant after: GoerTek Optical Technology Co.,Ltd. Address before: 266104 Laoshan Qingdao District North House Street investment service center room, Room 308, Shandong Applicant before: GOERTEK TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221116 Address after: 266104 Room 308, North Investment Street Service Center, Laoshan District, Qingdao, Shandong. Applicant after: GOERTEK TECHNOLOGY Co.,Ltd. Address before: 261061 east of Dongming Road, north of Yuqing East Street, Weifang High tech Zone, Weifang City, Shandong Province (Room 502, Geer electronics office building) Applicant before: GoerTek Optical Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190510 |
|
| RJ01 | Rejection of invention patent application after publication |