WO2019014853A1 - Method for detecting delay in head-mounted display data transmission, and head-mounted display - Google Patents

Method for detecting delay in head-mounted display data transmission, and head-mounted display Download PDF

Info

Publication number
WO2019014853A1
WO2019014853A1 PCT/CN2017/093379 CN2017093379W WO2019014853A1 WO 2019014853 A1 WO2019014853 A1 WO 2019014853A1 CN 2017093379 W CN2017093379 W CN 2017093379W WO 2019014853 A1 WO2019014853 A1 WO 2019014853A1
Authority
WO
WIPO (PCT)
Prior art keywords
processing module
video
module
mounted display
generation processing
Prior art date
Application number
PCT/CN2017/093379
Other languages
French (fr)
Chinese (zh)
Inventor
邓伍华
周坤
Original Assignee
深圳市柔宇科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市柔宇科技有限公司 filed Critical 深圳市柔宇科技有限公司
Priority to PCT/CN2017/093379 priority Critical patent/WO2019014853A1/en
Priority to CN201780060304.9A priority patent/CN109791297B/en
Publication of WO2019014853A1 publication Critical patent/WO2019014853A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays

Definitions

  • the present invention relates to a method of detecting data transmission delay of a head mounted display and a head mounted display.
  • An existing HMD Head Mount Display
  • a motion sensor includes a motion sensor, a first acquisition module, a video generation processing module, a video conversion processing module, and a display screen
  • the first acquisition module is electrically connected to the motion sensor.
  • the video generation processing module is electrically connected to the first collection module
  • the video conversion processing module is electrically connected to the video conversion processing module
  • the display screen is electrically connected to the video receiving module.
  • the delay time mainly includes the transmission time from the first acquisition module to the video conversion processing module (the time for the motion sensor to transmit data to the first acquisition module is short and can be ignored), and the test proves that when the delay time is >20 ms, This gives the user a noticeable vertigo. At present, there is no good way to detect this delay time. The delay time can only be calculated theoretically, and the accuracy cannot be guaranteed.
  • a technical problem to be solved by embodiments of the present invention is to provide a method for detecting data transmission delay of a head mounted display and a head mounted display. Accurately detects the delay time of the head mounted display.
  • a first aspect of the present invention provides a method for detecting a data transmission delay of a head mounted display, the head mounted display including a motion sensor, a first acquisition module, a video generation processing module, and a video conversion.
  • a processing module and a display screen the first collection module is electrically connected to the motion sensor, the video generation processing module is electrically connected to the first collection module, and the video conversion processing module and the video generation processing module are electrically connected Connected, the display screen is electrically connected to the video conversion processing module; the method includes:
  • the first collection module and the video conversion processing module respectively receive the opening at the first time t1. Commanding the signal while the video conversion processing module starts timing;
  • the first acquisition module receives and processes data of the motion sensor to obtain a sensing signal
  • the first collection module sends the sensing signal to the video generation processing module
  • the video generation processing module receives and processes the sensing signal to obtain a video signal
  • the video generation processing module sends the video signal to the video conversion processing module at a third time t3;
  • a second aspect of the present invention provides a head mounted display, including:
  • a first acquisition module which is electrically connected to the motion sensor and processed to transmit a sensing signal
  • a video generation processing module electrically connected to the first acquisition module to receive the sensing signal and processed to emit a video signal
  • a video conversion processing module electrically coupled to the video generation processing module to receive the video signal
  • the first acquisition module and the video conversion processing module respectively receive an open command signal at a first time t1, and the video conversion processing module starts timing;
  • the first acquisition module receives and processes data of the motion sensor to obtain a sensing signal
  • the first collection module sends the sensing signal to the video generation processing module
  • the video generation processing module receives and processes the sensing signal to obtain a video signal
  • the video generation processing module transmits the video signal to the video conversion processing module at a third time t3.
  • the method for detecting the data transmission delay of the head mounted display includes: at the first time t1, the first acquisition module and the video conversion processing module respectively receive an open command signal, and the video conversion processing module starts timing;
  • the first acquisition module receives and processes the number of the motion sensors Obtaining a sensing signal;
  • the first acquiring module sends the sensing signal to the video generation processing module;
  • the video generation processing module receives and processes the sensing signal to obtain a video signal; T3, the video generation processing module sends the video signal to the video conversion processing module; and calculates a delay time.
  • the method of the present invention can actually measure the delay time of the head mounted display, so that the obtained delay time accuracy can be ensured.
  • FIG. 1 is a flow chart of a method for detecting a data transmission delay of a head mounted display according to an embodiment of the present invention
  • FIG. 2 is a functional block diagram of a head mounted display according to an embodiment of the present invention.
  • 110-motion sensor 120-first acquisition module; 130-video generation processing module; 140-video conversion processing module; 150-display screen; 160-off module; 170-open module; 180-calculation module.
  • Embodiments of the present invention provide a method for detecting a data transmission delay of a head mounted display, the head mounted display including a motion sensor, a first acquisition module, a video generation processing module, a video conversion processing module, and a display screen.
  • the motion sensor is used to sense the motion of the wearer's head of the head mounted display, such as sensing left, right, up, down, moving speed, etc.
  • the motion sensor Including a power sensor, an acceleration sensor, a gyroscope, etc., the motion sensor transmits the sensed data to the first acquisition module;
  • the first acquisition module is electrically connected to the motion sensor, the first acquisition module
  • the data sent by the motion sensor is collated and processed into sensor data that can be recognized by the video generation processing module;
  • the video generation processing module is electrically connected to the first collection module, and the video generation processing module is used by Receiving the sensing data sent by the first collecting module, in addition, the video generating processing module further receives image data from other modules, such as image
  • the video generation processing module will image data and sensor data from the first acquisition module Line processing to generate video signals, which are video picture data that should be seen after the user wears the head mounted display, and the video signals are sent to the video conversion processing module; the video conversion processing module and the The video generation processing module is electrically connected, and the video conversion processing module processes the received video signal to convert into a signal that the display screen can recognize; the display screen is electrically connected to the video conversion processing module to be worn The video screen of the user of the head mounted display is displayed on the display so that the user can see the picture during and after the exercise.
  • the method for detecting data transmission delay of a head mounted display includes:
  • the first acquisition module and the video conversion processing module respectively receive an open command signal at a first time t1, and the video conversion processing module starts timing;
  • the head mounted display transmission open command signal is respectively sent to the first acquisition module and the video conversion processing module, so that the first acquisition module is at the first time t1.
  • the video conversion processing module receives the open command signal, and the video conversion processing module starts timing, so that the video conversion processing module can know the time point of the first time t1, where the first time t1 is the start of the calculation delay time. time.
  • the head mounted display includes an opening module, and the opening module is configured to implement a transmission opening command signal to the first collection module and the video conversion processing module respectively.
  • the opening module is a physical switch, and the physical switch is electrically connected to the first acquiring module and the video conversion processing module respectively.
  • the open command signal is a high level signal, but the present invention is not limited thereto. In other embodiments of the present invention, the open command signal may also be a low level signal. Of course, in other embodiments of the present invention, the open command signal may also be other level signals.
  • the opening module may also be an electronic switch or a communication bus or the like. In other embodiments of the invention, the switch command signal may also be a pulse signal, a communication protocol command, or the like.
  • the time for transmitting the start command signal is very short, it can be considered that the time when the video conversion processing module starts counting is the same time as the time when the open module sends the open command signal, that is, the open module can be considered to issue the open command signal.
  • the time is the first time t1.
  • the first collection module receives and processes data of the motion sensor to obtain a sensing signal.
  • the first acquisition module After the first acquisition module receives the open command signal, the first acquisition module starts to receive the data of the motion sensor, and performs processing to form a sensing signal. Specifically, the first The acquisition module sorts the data transmitted by the motion sensor into a sensing signal that the video generation processing module can recognize.
  • the first collection module sends the sensing signal to the video generation processing module.
  • the first collection module sends the sensing signal to the video generation processing module, after a certain period of time Thereafter, the sensing signal reaches the video signal generation processing module.
  • the video generation processing module receives and processes the sensing signal to obtain a video signal.
  • the video generation processing module when the video generation processing module does not receive the sensing data, the video generation processing module does not send video data to the video conversion processing module, and after a certain time, the video is generated. After the processing module receives the sensing data, the video generation processing module processes the sensing data and the image data received from other places to obtain a video signal, and then the video generation processing module is turned on by not transmitting data. A video signal is transmitted to the video conversion processing module.
  • the video generation processing module sends the video signal to the video conversion processing module at a third time t3;
  • the video conversion processing module starts timing at the first time t1, at which time the video conversion processing module can obtain the first time t1, and then the video conversion processing module waits for the video signal.
  • the video conversion processing module can obtain the third time t3, and the video conversion processing module can stop timing or continue timing.
  • the delay time is a difference between the third time t3 and the first time t1.
  • the delay time is a period of time during which the first acquisition module starts receiving data to the video conversion processing module to receive the video signal, and is an actual delay time of the head mounted display, so that the obtained delay time accuracy can be ensured.
  • the method for detecting the data transmission delay of the head mounted display before the step S120 further includes:
  • S110 Turn off the receiving and sending of data by the first collecting module, and sending the data by the video generating processing module.
  • the detector can close the receiving and transmitting of the data by the first collecting module at any time, so that the first collecting module does not receive data, and does not send data, that is, the video generating process.
  • the module will not receive sensory data from the first acquisition module.
  • Simultaneously closing the video generation processing module to send the video data so that the video conversion processing module does not receive the video data from the video generation processing module, and the video conversion processing module does not send the data to the display screen, so that the display screen does not
  • the image will be displayed and the display will be blank.
  • the detector can turn off the receiving and transmitting of data by the first collecting module and the data sending by the video generating processing module at any time, the detection of the delay time is facilitated. Thereafter, after the first acquisition module receives the open command signal, the first acquisition module receives and processes data of the motion sensor to obtain a sensing signal.
  • the delay time is obtained.
  • the delay time exceeds a certain threshold, for example, more than 20 ms, the user may have a significant vertigo feeling.
  • the delay time needs to be optimized to reduce the delay time. The delay time optimization is more targeted.
  • the method further includes:
  • the video generation processing module receives the open command signal and starts timing at a first time t1;
  • the video generation processing module receives the open command signal and triggers the start timing at the first time t1. Similarly, the opening The command signal is issued by the open module of the head mounted display.
  • the video generation processing module obtains the second time t2 when the first acquisition module sends the sensing signal to the video generation processing module.
  • the video generation processing module After the video generation processing module receives the start command signal, the video generation processing module starts timing. At this time, the video generation processing module may obtain the first time t1, and may also obtain the first time t1 by other means.
  • the video generation processing module may obtain the second time t2, the second time T2 - the first time t1 is the time delay between the start of receiving data by the first acquisition module and the receiving of the sensor data by the video generation processing module, and the time period of the third time t3 - the second time t2
  • the time delay between the start of receiving the sensing data by the video generation processing module and the start of receiving the video signal by the video conversion processing module, by analyzing the t2-t1 time period and the t3-t2 time period, according to convenience and difficulty Factors such as degree and cost can guide the subsequent optimization of the delay time.
  • the method further includes:
  • the delay time is displayed on the display screen.
  • the detector can intuitively see the delay time through the display.
  • the embodiment of the present invention further provides a head mounted display.
  • the motion sensor 110, the first collection module 120, the video generation processing module 130, the video conversion processing module 140, the display screen 150, and the calculation module 180 are provided. .
  • the first acquisition module 120 is electrically connected to the motion sensor 110 and transmits a sensing signal;
  • the video generation processing module 130 is electrically connected to the first collection module 120 to receive the sensing. a signal, and processed to emit a video signal;
  • the video conversion processing module 140 is electrically coupled to the video generation processing module 130 to receive a video signal;
  • the display screen 150 is electrically coupled to the video conversion processing module 140;
  • the calculation module 180 is configured to calculate the delay time.
  • the delay time is a difference between the third time t3 and the first time t1.
  • the first acquisition module 120, the video conversion processing at the first time t1 The module 140 receives the open command signal, and the video conversion processing module 140 starts timing; the first acquisition module 120 receives and processes the data of the motion sensor 110 to obtain a sensing signal; the first collecting module 120 sends Transmitting the sensing signal to the video generation processing module 130; then the video generation processing module 130 receives and processes the sensing signal to obtain a video signal; the video generation processing module 130 transmits the The video signal is sent to the video conversion processing module 140; the calculation module 180 can calculate the delay time.
  • the head mounted display further includes a shutdown module 160 for turning off the receiving and transmitting of the data by the sensing data acquisition module 120, and the video generation processing module. 130 pairs of data transmission.
  • the head mounted display further includes an opening module 170, and the opening command signal is sent by the opening module 170, and the opening module 170 is configured to transmit an opening command signal at the first time t1 respectively.
  • the opening module 170 can be a physical switch, an electronic switch or a communication bus, and the opening command signal sent by the opening module 170 includes a pulse. a signal, a level signal, or a communication protocol command; the calculation module 180 is configured to calculate the delay time.
  • the opening module 170 is further configured to transmit an open command signal to the video generation processing module 130, where the video generation processing module 130 receives the first time t1. Turning on the command signal and starting timing; the first acquisition module 120 sends the sensing signal to the video generation processing module 130 to obtain the second time t2, so that t2-t1 can be conveniently obtained. Time period and t3-t2 time period.
  • the first collection module 120, the video generation processing module 130, and the video conversion processing module 140 may be integrated into one processor, or two of them may be integrated into one processor, or The three modules are set separately.
  • the display screen 150 displays the delay time.
  • each embodiment in the present specification is described in a progressive manner, and each embodiment focuses on a difference from other embodiments, and the same similar parts between the various embodiments. You can refer to each other.
  • the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
  • the present invention has the following advantages:
  • the method for detecting the data transmission delay of the head mounted display includes: at the first time t1, the first acquisition module and the video conversion processing module respectively receive an open command signal, and the video conversion processing module starts timing;
  • the first acquisition module receives and processes data of the motion sensor to obtain a sensing signal;
  • the first acquisition module sends the sensing signal to the video generation processing module;
  • the video generation processing module receives and processes the The sensing signal is obtained to obtain a video signal; at a third time t3, the video generation processing module transmits the video signal to the video conversion processing module; and calculates a delay time.
  • the method of the present invention can actually measure the delay time of the head mounted display, so that the obtained delay time accuracy can be ensured.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

A head-mounted display, and a method for detecting a delay in head-mounted display data transmission, which have the advantage of accurately detecting delay time for a head-mounted display. The method comprises: at a first moment t1, a first acquisition module (120) and a video conversion processing module (140) respectively receiving an activation command signal, the video conversion processing module (140) simultaneously starting timing (S120); the first acquisition module (120) receiving and processing data from a motion sensor (110) so as to obtain a sensing signal (S130); the first acquisition module (120) sending the sensing signal to a video generation processing module (130) (S140); the video generation processing module (130) receiving and processing the sensing signal so as to obtain a video signal (S150); at a third moment t3, the video generation processing module (130) sending the video signal to the video conversion processing module (140) (S160); calculating delay time (S170).

Description

检测头戴式显示器数据传输延迟的方法及头戴式显示器Method for detecting data transmission delay of head mounted display and head mounted display 技术领域Technical field
本发明涉及一种检测头戴式显示器数据传输延迟的方法及头戴式显示器。The present invention relates to a method of detecting data transmission delay of a head mounted display and a head mounted display.
背景技术Background technique
现有的HMD(Head Mount Display，头戴式显示器)包括运动传感器、第一采集模块、视频产生处理模块、视频转换处理模块和显示屏，所述第一采集模块与所述运动传感器电连接，所述视频产生处理模块与所述第一采集模块电连接，所述视频转换处理模块与所述视频转换处理模块电连接，所述显示屏与所述视频接收模块电连接。当头部转动时，运动传感器获得的数据经由第一采集模块到达视频产生处理模块，结合图像数据后发送给视频转换处理模块最终到达显示屏进行显示，在此过程中存在一定数据传输延迟，此延迟时间主要包括从第一采集模块到视频转换处理模块之间的传输时间(运动传感器传送数据给第一采集模块的时间很短，可以忽略)，试验证明，当该延迟时间>20ms时，会使得用户产生明显的眩晕感。目前暂无很好的方法来检测此延迟时间，只能通过理论计算得出延迟时间，准确性无法保证。An existing HMD (Head Mount Display) includes a motion sensor, a first acquisition module, a video generation processing module, a video conversion processing module, and a display screen, and the first acquisition module is electrically connected to the motion sensor. The video generation processing module is electrically connected to the first collection module, the video conversion processing module is electrically connected to the video conversion processing module, and the display screen is electrically connected to the video receiving module. When the head rotates, the data obtained by the motion sensor reaches the video generation processing module via the first acquisition module, and is combined with the image data and sent to the video conversion processing module to finally reach the display screen for display, and there is a certain data transmission delay in the process. The delay time mainly includes the transmission time from the first acquisition module to the video conversion processing module (the time for the motion sensor to transmit data to the first acquisition module is short and can be ignored), and the test proves that when the delay time is >20 ms, This gives the user a noticeable vertigo. At present, there is no good way to detect this delay time. The delay time can only be calculated theoretically, and the accuracy cannot be guaranteed.
发明内容Summary of the invention
本发明实施例所要解决的技术问题在于，提供一种检测头戴式显示器数据传输延迟的方法及头戴式显示器。可准确检测头戴式显示器的延迟时间。A technical problem to be solved by embodiments of the present invention is to provide a method for detecting data transmission delay of a head mounted display and a head mounted display. Accurately detects the delay time of the head mounted display.
为了解决上述技术问题，本发明第一方面实施例提供了一种检测头戴式显示器数据传输延迟的方法，所述头戴式显示器包括运动传感器、第一采集模块、视频产生处理模块、视频转换处理模块和显示屏，所述第一采集模块与所述运动传感器电连接，所述视频产生处理模块与所述第一采集模块电连接，所述视频转换处理模块与所述视频产生处理模块电连接，所述显示屏与所述视频转换处理模块电连接；所述方法包括：In order to solve the above technical problem, a first aspect of the present invention provides a method for detecting a data transmission delay of a head mounted display, the head mounted display including a motion sensor, a first acquisition module, a video generation processing module, and a video conversion. a processing module and a display screen, the first collection module is electrically connected to the motion sensor, the video generation processing module is electrically connected to the first collection module, and the video conversion processing module and the video generation processing module are electrically connected Connected, the display screen is electrically connected to the video conversion processing module; the method includes:
在第一时刻t1所述第一采集模块、所述视频转换处理模块分别接收开启 命令信号，同时所述视频转换处理模块开始计时；The first collection module and the video conversion processing module respectively receive the opening at the first time t1. Commanding the signal while the video conversion processing module starts timing;
所述第一采集模块接收并处理所述运动传感器的数据以得到传感信号；The first acquisition module receives and processes data of the motion sensor to obtain a sensing signal;
所述第一采集模块发送所述传感信号至所述视频产生处理模块；The first collection module sends the sensing signal to the video generation processing module;
所述视频产生处理模块接收并处理所述传感信号以得到视频信号；The video generation processing module receives and processes the sensing signal to obtain a video signal;
在第三时刻t3所述视频产生处理模块发送所述视频信号至所述视频转换处理模块；The video generation processing module sends the video signal to the video conversion processing module at a third time t3;
计算获得延迟时间。Calculate the delay time.
本发明第二方面实施例提供了一种头戴式显示器，包括：A second aspect of the present invention provides a head mounted display, including:
运动传感器；Motion sensor
第一采集模块，其与所述运动传感器电连接并经过处理后发送传感信号；a first acquisition module, which is electrically connected to the motion sensor and processed to transmit a sensing signal;
视频产生处理模块，其与所述第一采集模块电连接以接收所述传感信号，并经过处理后发出视频信号；a video generation processing module electrically connected to the first acquisition module to receive the sensing signal and processed to emit a video signal;
视频转换处理模块，其与所述视频产生处理模块电连接以接收所述视频信号；a video conversion processing module electrically coupled to the video generation processing module to receive the video signal;
显示屏，其与所述视频转换处理模块电连接；a display screen electrically connected to the video conversion processing module;
计算模块，其用于计算获得延迟时间；其中，a calculation module for calculating a delay time; wherein
在第一时刻t1所述第一采集模块、所述视频转换处理模块分别接收开启命令信号，同时所述视频转换处理模块开始计时；The first acquisition module and the video conversion processing module respectively receive an open command signal at a first time t1, and the video conversion processing module starts timing;
所述第一采集模块接收并处理所述运动传感器的数据以得到传感信号；The first acquisition module receives and processes data of the motion sensor to obtain a sensing signal;
所述第一采集模块发送所述传感信号至所述视频产生处理模块；The first collection module sends the sensing signal to the video generation processing module;
所述视频产生处理模块接收并处理所述传感信号以得到视频信号；The video generation processing module receives and processes the sensing signal to obtain a video signal;
在第三时刻t3所述视频产生处理模块发送所述视频信号至所述视频转换处理模块。The video generation processing module transmits the video signal to the video conversion processing module at a third time t3.
实施本发明实施例，具有如下有益效果：Embodiments of the present invention have the following beneficial effects:
由于所述检测头戴式显示器数据传输延迟的方法包括：在第一时刻t1所述第一采集模块、所述视频转换处理模块分别接收开启命令信号，同时所述视频转换处理模块开始计时；所述第一采集模块接收并处理所述运动传感器的数 据以得到传感信号；所述第一采集模块发送所述传感信号至所述视频产生处理模块；所述视频产生处理模块接收并处理所述传感信号以得到视频信号；在第三时刻t3所述视频产生处理模块发送所述视频信号至所述视频转换处理模块；计算获得延迟时间。本发明的方法可以实际测到头戴式显示器的延迟时间，从而获得的延迟时间准确性可以保证。The method for detecting the data transmission delay of the head mounted display includes: at the first time t1, the first acquisition module and the video conversion processing module respectively receive an open command signal, and the video conversion processing module starts timing; The first acquisition module receives and processes the number of the motion sensors Obtaining a sensing signal; the first acquiring module sends the sensing signal to the video generation processing module; the video generation processing module receives and processes the sensing signal to obtain a video signal; T3, the video generation processing module sends the video signal to the video conversion processing module; and calculates a delay time. The method of the present invention can actually measure the delay time of the head mounted display, so that the obtained delay time accuracy can be ensured.
附图说明DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.
图1是本发明一实施例检测头戴式显示器数据传输延迟的方法的流程图；1 is a flow chart of a method for detecting a data transmission delay of a head mounted display according to an embodiment of the present invention;
图2是本发明一实施例头戴式显示器的功能模块图；2 is a functional block diagram of a head mounted display according to an embodiment of the present invention;
图示标号：Graphic label:
110-运动传感器；120-第一采集模块；130-视频产生处理模块；140-视频转换处理模块；150-显示屏；160-关闭模块；170-开启模块；180-计算模块。110-motion sensor; 120-first acquisition module; 130-video generation processing module; 140-video conversion processing module; 150-display screen; 160-off module; 170-open module; 180-calculation module.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
本申请说明书、权利要求书和附图中出现的术语“包括”和“具有”以及它们任何变形，意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元，而是可选地还包括没有列出的步骤或单元，或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。此外，术语“第一”、“第二”和“第三”等是用于区别不同的对象，而并非用于描述特定的顺序。 The terms "comprising" and "having", and any variations thereof, appearing in the specification, the claims, and the drawings are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that comprises a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units not listed, or, optionally, Other steps or units inherent to these processes, methods, products or equipment. Moreover, the terms "first," "second," and "third," etc. are used to distinguish different objects, and are not intended to describe a particular order.
本发明实施例提供一种检测头戴式显示器数据传输延迟的方法，所述头戴式显示器包括运动传感器、第一采集模块、视频产生处理模块、视频转换处理模块和显示屏。在本实施例中，所述运动传感器用于感测头戴式显示器的佩戴者头部的运动，例如感测左移、右移、上移、下移、移动速度等指标，所述运动传感器包括动力传感器、加速度传感器、陀螺仪等，所述运动传感器将感测到的数据传送给所述第一采集模块；所述第一采集模块与所述运动传感器电连接，所述第一采集模块将所述运动传感器传送过来的数据进行整理，处理成所述视频产生处理模块可以识别的传感数据；所述视频产生处理模块与所述第一采集模块电连接，所述视频产生处理模块用于接收所述第一采集模块发送的传感数据，另外，所述视频产生处理模块还会接受来自其他模块的图像数据，例如游戏画面、视频画面等图像数据，该些图像数据可以来自本地，也可以来自网络，所述视频产生处理模块将图像数据和来自所述第一采集模块的传感数据进行处理，以产生视频信号，该些视频信号是佩戴头戴式显示器用户运动后应该看到的视频画面数据，该些视频信号发送给所述视频转换处理模块；所述视频转换处理模块与所述视频产生处理模块电连接，所述视频转换处理模块对接收到的视频信号进行处理，以转换成显示屏可以识别的信号；所述显示屏与所述视频转换处理模块电连接，以将佩戴头戴式显示器的用户运动后的视频画面在显示屏上显示，从而用户可以看到运动过程中和运动后的画面。请参见图1，所述检测头戴式显示器数据传输延迟的方法包括：Embodiments of the present invention provide a method for detecting a data transmission delay of a head mounted display, the head mounted display including a motion sensor, a first acquisition module, a video generation processing module, a video conversion processing module, and a display screen. In this embodiment, the motion sensor is used to sense the motion of the wearer's head of the head mounted display, such as sensing left, right, up, down, moving speed, etc., the motion sensor Including a power sensor, an acceleration sensor, a gyroscope, etc., the motion sensor transmits the sensed data to the first acquisition module; the first acquisition module is electrically connected to the motion sensor, the first acquisition module The data sent by the motion sensor is collated and processed into sensor data that can be recognized by the video generation processing module; the video generation processing module is electrically connected to the first collection module, and the video generation processing module is used by Receiving the sensing data sent by the first collecting module, in addition, the video generating processing module further receives image data from other modules, such as image data such as a game screen and a video screen, and the image data may be from a local area. Also from the network, the video generation processing module will image data and sensor data from the first acquisition module Line processing to generate video signals, which are video picture data that should be seen after the user wears the head mounted display, and the video signals are sent to the video conversion processing module; the video conversion processing module and the The video generation processing module is electrically connected, and the video conversion processing module processes the received video signal to convert into a signal that the display screen can recognize; the display screen is electrically connected to the video conversion processing module to be worn The video screen of the user of the head mounted display is displayed on the display so that the user can see the picture during and after the exercise. Referring to FIG. 1, the method for detecting data transmission delay of a head mounted display includes:
S120:在第一时刻t1所述第一采集模块、所述视频转换处理模块分别接收开启命令信号，同时所述视频转换处理模块开始计时；S120: The first acquisition module and the video conversion processing module respectively receive an open command signal at a first time t1, and the video conversion processing module starts timing;
在本实施例中，当检测者触发开始检测延迟时间时，所述头戴式显示器传输开启命令信号分别给第一采集模块、视频转换处理模块，从而在第一时刻t1所述第一采集模块、所述视频转换处理模块分别接收开启命令信号，同时所述视频转换处理模块开始计时，从而视频转换处理模块可以获知该第一时刻t1的时间点，该第一时刻t1为计算延迟时间开始的时间。具体说来，在本实施例中，所述头戴式显示器包括开启模块，所述开启模块用于实现传输开启命令信号分别给第一采集模块、视频转换处理模块。所述开启模块在本实施例中是物理开关，所述物理开关分别与第一采集模块、视频转换处理模块电连接，当 用户将物理开关打到闭合状态时，该物理开关的闭合产生开启命令信号。在本实施例中，所述开启命令信号为高电平信号，但本发明不限于此，在本发明的其他实施例中，所述开启命令信号还可以为低电平信号。当然，在本发明的其他实施例中，所述开启命令信号还可以为其他的电平信号。另外，在本发明的其他实施例中，所述开启模块还可以为电子开关或通信总线等。在本发明的其他实施例中，所述开关命令信号还可以为脉冲信号、通信协议命令等。在本实施例中，由于传输开启命令信号的时间非常短，从而可以认为视频转换处理模块开始计时的时间与开启模块发出开启命令信号的时间为同一时刻，也即可以认为开启模块发出开启命令信号的时间为第一时刻t1。In this embodiment, when the detector triggers the start detection delay time, the head mounted display transmission open command signal is respectively sent to the first acquisition module and the video conversion processing module, so that the first acquisition module is at the first time t1. The video conversion processing module receives the open command signal, and the video conversion processing module starts timing, so that the video conversion processing module can know the time point of the first time t1, where the first time t1 is the start of the calculation delay time. time. Specifically, in the embodiment, the head mounted display includes an opening module, and the opening module is configured to implement a transmission opening command signal to the first collection module and the video conversion processing module respectively. In the embodiment, the opening module is a physical switch, and the physical switch is electrically connected to the first acquiring module and the video conversion processing module respectively. When the user switches the physical switch to the closed state, the closing of the physical switch generates an open command signal. In this embodiment, the open command signal is a high level signal, but the present invention is not limited thereto. In other embodiments of the present invention, the open command signal may also be a low level signal. Of course, in other embodiments of the present invention, the open command signal may also be other level signals. In addition, in other embodiments of the present invention, the opening module may also be an electronic switch or a communication bus or the like. In other embodiments of the invention, the switch command signal may also be a pulse signal, a communication protocol command, or the like. In this embodiment, since the time for transmitting the start command signal is very short, it can be considered that the time when the video conversion processing module starts counting is the same time as the time when the open module sends the open command signal, that is, the open module can be considered to issue the open command signal. The time is the first time t1.
S130:所述第一采集模块接收并处理所述运动传感器的数据以得到传感信号；S130: The first collection module receives and processes data of the motion sensor to obtain a sensing signal.
在本实施例中，当所述第一采集模块接收到开启命令信号后，所述第一采集模块开始接收运动传感器的数据，并进行处理后形成传感信号，具体说来，所述第一采集模块将所述运动传感器传送过来的数据进行整理，处理成所述视频产生处理模块可以识别的传感信号。In this embodiment, after the first acquisition module receives the open command signal, the first acquisition module starts to receive the data of the motion sensor, and performs processing to form a sensing signal. Specifically, the first The acquisition module sorts the data transmitted by the motion sensor into a sensing signal that the video generation processing module can recognize.
S140:所述第一采集模块发送所述传感信号至所述视频产生处理模块；S140: The first collection module sends the sensing signal to the video generation processing module.
在本实施例中，当所述第一采集模块将所述运动传感器的数据处理成传感信号后，所述第一采集模块向所述视频产生处理模块发送所述传感信号，经过一定时间后，所述传感信号到达所述视频信号产生处理模块。In this embodiment, after the first acquisition module processes the data of the motion sensor into a sensing signal, the first collection module sends the sensing signal to the video generation processing module, after a certain period of time Thereafter, the sensing signal reaches the video signal generation processing module.
S150：所述视频产生处理模块接收并处理所述传感信号以得到视频信号；S150: The video generation processing module receives and processes the sensing signal to obtain a video signal.
在本实施例中，当所述视频产生处理模块未接收到传感数据时，所述视频产生处理模块不会发送视频数据给所述视频转换处理模块，当经过一定时间后，所述视频产生处理模块接收到所述传感数据后，所述视频产生处理模块对传感数据和从其他处接收的图像数据进行处理以得到视频信号，然后所述视频产生处理模块由不发送数据转为开启传输视频信号给所述视频转换处理模块。In this embodiment, when the video generation processing module does not receive the sensing data, the video generation processing module does not send video data to the video conversion processing module, and after a certain time, the video is generated. After the processing module receives the sensing data, the video generation processing module processes the sensing data and the image data received from other places to obtain a video signal, and then the video generation processing module is turned on by not transmitting data. A video signal is transmitted to the video conversion processing module.
S160:在第三时刻t3所述视频产生处理模块发送所述视频信号至所述视频转换处理模块；S160: The video generation processing module sends the video signal to the video conversion processing module at a third time t3;
在本实施例中，视频转换处理模块在第一时刻t1开始计时，此时所述视频转换处理模块可以获得第一时刻t1，其后视频转换处理模块等待视频信号的 到来，当检测到视频信号的第一帧结束时(通过检测帧同步信号的边沿)，所述视频转换处理模块可以获得第三时刻t3，所述视频转换处理模块可以停止计时或者继续计时。In this embodiment, the video conversion processing module starts timing at the first time t1, at which time the video conversion processing module can obtain the first time t1, and then the video conversion processing module waits for the video signal. Coming, when the end of the first frame of the video signal is detected (by detecting the edge of the frame synchronization signal), the video conversion processing module can obtain the third time t3, and the video conversion processing module can stop timing or continue timing.
S170:计算获得所述延迟时间。S170: Calculate the obtained delay time.
在本实施例中，所述延迟时间为第三时刻t3与第一时刻t1的差值。该延迟时间为所述第一采集模块开始接收数据到所述视频转换处理模块接收到视频信号这个时间段，为头戴式显示器实际的延迟时间，从而获得的延迟时间准确性可以保证。In this embodiment, the delay time is a difference between the third time t3 and the first time t1. The delay time is a period of time during which the first acquisition module starts receiving data to the video conversion processing module to receive the video signal, and is an actual delay time of the head mounted display, so that the obtained delay time accuracy can be ensured.
为了方便检测者随时检测头戴式显示器的数据传输延迟时间，在S120步骤之前所述检测头戴式显示器数据传输延迟的方法还包括：In order to facilitate the detection of the data transmission delay time of the head mounted display, the method for detecting the data transmission delay of the head mounted display before the step S120 further includes:
S110：关闭所述第一采集模块对数据的接收和发送、所述视频产生处理模块对数据的发送。S110: Turn off the receiving and sending of data by the first collecting module, and sending the data by the video generating processing module.
在本实施例中，检测者可以随时关闭所述第一采集模块对数据的接收和发送，从而，所述第一采集模块不会接收数据，也不会发送数据，也即所述视频产生处理模块不会接收到来自第一采集模块的传感数据。同时关闭所述视频产生处理模块对视频数据的发送，从而所述视频转换处理模块接收不到来自视频产生处理模块处的视频数据，视频转换处理模块不会发送数据给显示屏，从而显示屏不会显示图像，此时显示屏黑屏。在本实施例中，由于检测者可以随时关闭所述第一采集模块对数据的接收和发送、所述视频产生处理模块对数据的发送，从而方便了对延迟时间的检测。其后，当所述第一采集模块接收开启命令信号后，所述第一采集模块接收并处理所述运动传感器的数据以得到传感信号。In this embodiment, the detector can close the receiving and transmitting of the data by the first collecting module at any time, so that the first collecting module does not receive data, and does not send data, that is, the video generating process. The module will not receive sensory data from the first acquisition module. Simultaneously closing the video generation processing module to send the video data, so that the video conversion processing module does not receive the video data from the video generation processing module, and the video conversion processing module does not send the data to the display screen, so that the display screen does not The image will be displayed and the display will be blank. In this embodiment, since the detector can turn off the receiving and transmitting of data by the first collecting module and the data sending by the video generating processing module at any time, the detection of the delay time is facilitated. Thereafter, after the first acquisition module receives the open command signal, the first acquisition module receives and processes data of the motion sensor to obtain a sensing signal.
根据本技术方案得到延迟时间，当该延迟时间超过某个阈值，例如超过20ms，会使得用户产生明显的眩晕感，为了减少该眩晕感，从而需要对延迟时间进行优化，以减少延迟时间，为了使延迟时间优化更有针对性，在本实施例中，所述方法还包括：According to the technical solution, the delay time is obtained. When the delay time exceeds a certain threshold, for example, more than 20 ms, the user may have a significant vertigo feeling. In order to reduce the stun feeling, the delay time needs to be optimized to reduce the delay time. The delay time optimization is more targeted. In this embodiment, the method further includes:
在第一时刻t1所述视频产生处理模块接收所述开启命令信号并开始计时；The video generation processing module receives the open command signal and starts timing at a first time t1;
在本实施例中，同第一采集模块、视频转换处理模块一样，在第一时刻t1所述视频产生处理模块会接收开启命令信号并触发开始计时，同样，所述开启 命令信号是头戴式显示器的开启模块发出的。In this embodiment, as in the first acquisition module and the video conversion processing module, the video generation processing module receives the open command signal and triggers the start timing at the first time t1. Similarly, the opening The command signal is issued by the open module of the head mounted display.
所述第一采集模块发送所述传感信号至所述视频产生处理模块时所述视频产生处理模块得到第二时刻t2。The video generation processing module obtains the second time t2 when the first acquisition module sends the sensing signal to the video generation processing module.
当视频产生处理模块接收到开启命令信号后所述视频产生处理模块开始计时，此时所述视频产生处理模块可以获得第一时刻t1，当然也可以通过其他方式获得第一时刻t1，当所述视频产生处理模块接收到传感信号时，也即所述第一采集模块发送所述传感信号至所述视频产生处理模块时，所述视频产生处理模块可以得到第二时刻t2，第二时刻t2-第一时刻t1这个时间段为所述第一采集模块开始接收数据到所述视频产生处理模块接收到传感数据之间的时间延迟，而第三时刻t3-第二时刻t2这个时间段是所述视频产生处理模块开始接收传感数据到所述视频转换处理模块开始接收视频信号之间的时间延迟，通过分析t2-t1时间段和t3-t2时间段，进而根据方便性、难易程度、成本等因素，可以指导后续对延迟时间进行优化。After the video generation processing module receives the start command signal, the video generation processing module starts timing. At this time, the video generation processing module may obtain the first time t1, and may also obtain the first time t1 by other means. When the video generation processing module receives the sensing signal, that is, when the first acquisition module sends the sensing signal to the video generation processing module, the video generation processing module may obtain the second time t2, the second time T2 - the first time t1 is the time delay between the start of receiving data by the first acquisition module and the receiving of the sensor data by the video generation processing module, and the time period of the third time t3 - the second time t2 The time delay between the start of receiving the sensing data by the video generation processing module and the start of receiving the video signal by the video conversion processing module, by analyzing the t2-t1 time period and the t3-t2 time period, according to convenience and difficulty Factors such as degree and cost can guide the subsequent optimization of the delay time.
为了方便检测人员比较直观的看到延迟时间，在本实施例中，在所述计算获得所述延迟时间的步骤之后还包括：In order to facilitate the inspector to see the delay time more intuitively, in the embodiment, after the step of calculating the delay time by the calculation, the method further includes:
在所述显示屏上显示所述延迟时间。The delay time is displayed on the display screen.
由于显示屏直接显示所述延迟时间，从而检测者可以直观的通过显示屏看到延迟时间。Since the display directly displays the delay time, the detector can intuitively see the delay time through the display.
另外，本发明实施例还提供一种头戴式显示器，请参见图2，包括运动传感器110、第一采集模块120、视频产生处理模块130、视频转换处理模块140、显示屏150和计算模块180。In addition, the embodiment of the present invention further provides a head mounted display. Referring to FIG. 2, the motion sensor 110, the first collection module 120, the video generation processing module 130, the video conversion processing module 140, the display screen 150, and the calculation module 180 are provided. .
在本实施例中，所述第一采集模块120与所述运动传感器110电连接并发送传感信号；所述视频产生处理模块130与所述第一采集模块120电连接以接收所述传感信号，并经过处理后发出视频信号；所述视频转换处理模块140与所述视频产生处理模块130电连接以接收视频信号；所述显示屏150与所述视频转换处理模块140电连接；所述计算模块180用于计算获得所述延迟时间，在本实施例中，所述延迟时间为第三时刻t3与第一时刻t1的差值。In this embodiment, the first acquisition module 120 is electrically connected to the motion sensor 110 and transmits a sensing signal; the video generation processing module 130 is electrically connected to the first collection module 120 to receive the sensing. a signal, and processed to emit a video signal; the video conversion processing module 140 is electrically coupled to the video generation processing module 130 to receive a video signal; the display screen 150 is electrically coupled to the video conversion processing module 140; The calculation module 180 is configured to calculate the delay time. In the embodiment, the delay time is a difference between the third time t3 and the first time t1.
在本实施例中，在第一时刻t1所述第一采集模块120、所述视频转换处理 模块140分别接收开启命令信号，同时所述视频转换处理模块140开始计时；所述第一采集模块120接收并处理所述运动传感器110的数据以得到传感信号；所述第一采集模块120发送所述传感信号至所述视频产生处理模块130；然后所述视频产生处理模块130接收并处理所述传感信号以得到视频信号；在第三时刻t3所述视频产生处理模块130发送所述视频信号至所述视频转换处理模块140；计算模块180可以计算获得所述延迟时间。In this embodiment, the first acquisition module 120, the video conversion processing at the first time t1 The module 140 receives the open command signal, and the video conversion processing module 140 starts timing; the first acquisition module 120 receives and processes the data of the motion sensor 110 to obtain a sensing signal; the first collecting module 120 sends Transmitting the sensing signal to the video generation processing module 130; then the video generation processing module 130 receives and processes the sensing signal to obtain a video signal; the video generation processing module 130 transmits the The video signal is sent to the video conversion processing module 140; the calculation module 180 can calculate the delay time.
为了方便随时检测延迟时间，在本实施例中，所述头戴式显示器还包括关闭模块160，所述关闭模块160用于关闭传感数据采集模块120对数据的接收和发送、视频产生处理模块130对数据的发送。In the present embodiment, the head mounted display further includes a shutdown module 160 for turning off the receiving and transmitting of the data by the sensing data acquisition module 120, and the video generation processing module. 130 pairs of data transmission.
在本实施例中，所述头戴式显示器还包括开启模块170，所述开启命令信号是通过所述开启模块170发出的，所述开启模块170用于在第一时刻t1传输开启命令信号分别给传感数据采集模块120、视频接收处理模块140，在本实施例中，所述开启模块170可以为物理开关、电子开关或者通信总线，所述开启模块170所发处的开启命令信号包括脉冲信号、电平信号或者通信协议命令；所述计算模块180用于计算获得所述延迟时间。In this embodiment, the head mounted display further includes an opening module 170, and the opening command signal is sent by the opening module 170, and the opening module 170 is configured to transmit an opening command signal at the first time t1 respectively. In the embodiment, the opening module 170 can be a physical switch, an electronic switch or a communication bus, and the opening command signal sent by the opening module 170 includes a pulse. a signal, a level signal, or a communication protocol command; the calculation module 180 is configured to calculate the delay time.
为了方便对延迟时间进行优化，在本实施例中，所述开启模块170还用于传输开启命令信号给所述视频产生处理模块130，在第一时刻t1所述视频产生处理模块130接收所述开启命令信号并开始计时；所述第一采集模块120发送所述传感信号至所述视频产生处理模块130时所述视频产生处理模块130以得到第二时刻t2，从而可以方便获得t2-t1时间段和t3-t2时间段。In order to facilitate the optimization of the delay time, in the embodiment, the opening module 170 is further configured to transmit an open command signal to the video generation processing module 130, where the video generation processing module 130 receives the first time t1. Turning on the command signal and starting timing; the first acquisition module 120 sends the sensing signal to the video generation processing module 130 to obtain the second time t2, so that t2-t1 can be conveniently obtained. Time period and t3-t2 time period.
在本实施例中，所述第一采集模块120、所述视频产生处理模块130、所述视频转换处理模块140可以集成在一个处理器中，也可以其中两个集成在一个处理器中，或者三个模块单独设置。In this embodiment, the first collection module 120, the video generation processing module 130, and the video conversion processing module 140 may be integrated into one processor, or two of them may be integrated into one processor, or The three modules are set separately.
另外，为了方便检查人员获得延迟时间，在本实施例中，所述显示屏150显示所述延迟时间。In addition, in order to facilitate the inspector to obtain the delay time, in the present embodiment, the display screen 150 displays the delay time.
需要说明的是，本说明书中的各个实施例均采用递进的方式描述，每个实施例重点说明的都是与其它实施例的不同之处，各个实施例之间相同相似的部 分互相参见即可。对于装置实施例而言，由于其与方法实施例基本相似，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。It should be noted that each embodiment in the present specification is described in a progressive manner, and each embodiment focuses on a difference from other embodiments, and the same similar parts between the various embodiments. You can refer to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
通过上述实施例的描述，本发明具有以下优点：Through the description of the above embodiments, the present invention has the following advantages:
由于所述检测头戴式显示器数据传输延迟的方法包括：在第一时刻t1所述第一采集模块、所述视频转换处理模块分别接收开启命令信号，同时所述视频转换处理模块开始计时；所述第一采集模块接收并处理所述运动传感器的数据以得到传感信号；所述第一采集模块发送所述传感信号至所述视频产生处理模块；所述视频产生处理模块接收并处理所述传感信号以得到视频信号；在第三时刻t3所述视频产生处理模块发送所述视频信号至所述视频转换处理模块；计算获得延迟时间。本发明的方法可以实际测到头戴式显示器的延迟时间，从而获得的延迟时间准确性可以保证。The method for detecting the data transmission delay of the head mounted display includes: at the first time t1, the first acquisition module and the video conversion processing module respectively receive an open command signal, and the video conversion processing module starts timing; The first acquisition module receives and processes data of the motion sensor to obtain a sensing signal; the first acquisition module sends the sensing signal to the video generation processing module; and the video generation processing module receives and processes the The sensing signal is obtained to obtain a video signal; at a third time t3, the video generation processing module transmits the video signal to the video conversion processing module; and calculates a delay time. The method of the present invention can actually measure the delay time of the head mounted display, so that the obtained delay time accuracy can be ensured.
以上所揭露的仅为本发明较佳实施例而已，当然不能以此来限定本发明之权利范围，因此依本发明权利要求所作的等同变化，仍属本发明所涵盖的范围。 The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, and thus equivalent changes made in the claims of the present invention are still within the scope of the present invention.

Claims (17)

  1. 一种检测头戴式显示器数据传输延迟的方法，所述头戴式显示器包括运动传感器、第一采集模块、视频产生处理模块、视频转换处理模块和显示屏，所述第一采集模块与所述运动传感器电连接，所述视频产生处理模块与所述第一采集模块电连接，所述视频转换处理模块与所述视频产生处理模块电连接，所述显示屏与所述视频转换处理模块电连接；其特征在于，所述方法包括：A method for detecting a data transmission delay of a head mounted display, the head mounted display comprising a motion sensor, a first acquisition module, a video generation processing module, a video conversion processing module, and a display screen, the first acquisition module and the The motion sensor is electrically connected, the video generation processing module is electrically connected to the first acquisition module, the video conversion processing module is electrically connected to the video generation processing module, and the display screen is electrically connected to the video conversion processing module. ; characterized in that the method comprises:
    在第一时刻t1所述第一采集模块、所述视频转换处理模块分别接收开启命令信号，同时所述视频转换处理模块开始计时；The first acquisition module and the video conversion processing module respectively receive an open command signal at a first time t1, and the video conversion processing module starts timing;
    所述第一采集模块接收并处理所述运动传感器的数据以得到传感信号；The first acquisition module receives and processes data of the motion sensor to obtain a sensing signal;
    所述第一采集模块发送所述传感信号至所述视频产生处理模块；The first collection module sends the sensing signal to the video generation processing module;
    所述视频产生处理模块接收并处理所述传感信号以得到视频信号；The video generation processing module receives and processes the sensing signal to obtain a video signal;
    在第三时刻t3所述视频产生处理模块发送所述视频信号至所述视频转换处理模块；The video generation processing module sends the video signal to the video conversion processing module at a third time t3;
    计算获得延迟时间。Calculate the delay time.
  2. 如权利要求1所述的检测头戴式显示器数据传输延迟的方法，其特征在于，所述延迟时间为第三时刻t3与第一时刻t1的差值。The method of detecting a data transmission delay of a head mounted display according to claim 1, wherein the delay time is a difference between the third time t3 and the first time t1.
  3. 如权利要求1所述的检测头戴式显示器数据传输延迟的方法，其特征在于，在所述在第一时刻t1所述第一采集模块、所述视频转换处理模块分别接收传输开启命令信号，同时所述视频转换处理模块开始计时的步骤之前还包括：The method for detecting a data transmission delay of a head mounted display according to claim 1, wherein the first acquisition module and the video conversion processing module respectively receive a transmission open command signal at the first time t1, At the same time, the step of starting the timing of the video conversion processing module further includes:
    关闭所述第一采集模块对数据的接收和发送、所述视频产生处理模块对数据的发送。The receiving and transmitting of the data by the first collecting module and the sending of the data by the video generating processing module are closed.
  4. 如权利要求1所述的检测头戴式显示器数据传输延迟的方法，其特征在于，所述头戴式显示器还包括开启模块，所述开启命令信号是通过所述开启模块发出的。 The method of detecting a data transmission delay of a head mounted display according to claim 1, wherein the head mounted display further comprises an opening module, and the opening command signal is sent by the opening module.
  5. 如权利要求4所述的检测头戴式显示器数据传输延迟的方法，其特征在于，所述开启模块为物理开关、电子开关或者通信总线。The method of detecting data transmission delay of a head mounted display according to claim 4, wherein the opening module is a physical switch, an electronic switch or a communication bus.
  6. 如权利要求1所述的检测头戴式显示器数据传输延迟的方法，其特征在于，所述开启命令信号包括脉冲信号、电平信号或者通信协议命令。A method of detecting a data transmission delay of a head mounted display according to claim 1, wherein said open command signal comprises a pulse signal, a level signal or a communication protocol command.
  7. 如权利要求1所述的检测头戴式显示器数据传输延迟的方法，其特征在于，所述方法还包括：The method of detecting a data transmission delay of a head mounted display according to claim 1, wherein the method further comprises:
    在第一时刻t1所述视频产生处理模块接收所述开启命令信号并开始计时；The video generation processing module receives the open command signal and starts timing at a first time t1;
    当所述第一采集模块发送所述传感信号至所述视频产生处理模块时所述视频产生处理模块得到第二时刻t2。The video generation processing module obtains the second time t2 when the first acquisition module sends the sensing signal to the video generation processing module.
  8. 如权利要求1所述的检测头戴式显示器数据传输延迟的方法，其特征在于，在所述计算获得延迟时间的步骤之后还包括：The method of detecting a data transmission delay of a head mounted display according to claim 1, wherein after the step of calculating the delay time, the method further comprises:
    在所述显示屏上显示所述延迟时间。The delay time is displayed on the display screen.
  9. 一种头戴式显示器，其特征在于，包括：A head mounted display, comprising:
    运动传感器；Motion sensor
    第一采集模块，其与所述运动传感器电连接并经过处理后发送传感信号；a first acquisition module, which is electrically connected to the motion sensor and processed to transmit a sensing signal;
    视频产生处理模块，其与所述第一采集模块电连接以接收所述传感信号，并经过处理后发出视频信号；a video generation processing module electrically connected to the first acquisition module to receive the sensing signal and processed to emit a video signal;
    视频转换处理模块，其与所述视频产生处理模块电连接以接收所述视频信号；a video conversion processing module electrically coupled to the video generation processing module to receive the video signal;
    显示屏，其与所述视频转换处理模块电连接；a display screen electrically connected to the video conversion processing module;
    计算模块，其用于计算获得延迟时间；其中，a calculation module for calculating a delay time; wherein
    在第一时刻t1所述第一采集模块、所述视频转换处理模块分别接收开启命令信号，同时所述视频转换处理模块开始计时；The first acquisition module and the video conversion processing module respectively receive an open command signal at a first time t1, and the video conversion processing module starts timing;
    所述第一采集模块接收并处理所述运动传感器的数据以得到传感信号； The first acquisition module receives and processes data of the motion sensor to obtain a sensing signal;
    所述第一采集模块发送所述传感信号至所述视频产生处理模块；The first collection module sends the sensing signal to the video generation processing module;
    所述视频产生处理模块接收并处理所述传感信号以得到视频信号；The video generation processing module receives and processes the sensing signal to obtain a video signal;
    在第三时刻t3所述视频产生处理模块发送所述视频信号至所述视频转换处理模块。The video generation processing module transmits the video signal to the video conversion processing module at a third time t3.
  10. 如权利要求9所述的头戴式显示器，其特征在于，所述延迟时间为第三时刻t3与第一时刻t1的差值。A head mounted display according to claim 9, wherein said delay time is a difference between the third time t3 and the first time t1.
  11. 如权利要求9所述的头戴式显示器，其特征在于，还包括关闭模块，其用于关闭所述第一采集模块对数据的接收和发送、所述视频产生处理模块对数据的发送。The head mounted display of claim 9, further comprising a shutdown module for turning off reception and transmission of data by the first acquisition module and transmission of data by the video generation processing module.
  12. 如权利要求9所述的头戴式显示器，其特征在于，所述头戴式显示器还包括开启模块，所述开启命令信号是通过所述开启模块发出的。A head mounted display according to claim 9, wherein said head mounted display further comprises an opening module, said opening command signal being issued by said opening module.
  13. 如权利要求12所述的头戴式显示器，其特征在于，其特征在于，所述开启模块为物理开关、电子开关或者通信总线。A head mounted display according to claim 12, wherein said opening module is a physical switch, an electronic switch or a communication bus.
  14. 如权利要求9所述的头戴式显示器，其特征在于，所述开启命令信号包括脉冲信号、电平信号或者通信协议命令。A head mounted display according to claim 9, wherein said open command signal comprises a pulse signal, a level signal or a communication protocol command.
  15. 如权利要求9所述的头戴式显示器，其特征在于，在第一时刻t1所述视频产生处理模块接收所述开启命令信号并开始计时；当所述第一采集模块发送所述传感信号至所述视频产生处理模块时所述视频产生处理模块以得到第二时刻t2。The head-mounted display according to claim 9, wherein the video generation processing module receives the open command signal and starts timing at a first time t1; and when the first acquisition module transmits the sensing signal The video generation processing module to the video generation processing module to obtain the second time instant t2.
  16. 如权利要求9所述的头戴式显示器，其特征在于，所述显示屏显示所述延迟时间。 A head mounted display according to claim 9, wherein said display screen displays said delay time.
  17. 如权利要求9所述的头戴式显示器，其特征在于，所述第一采集模块、所述视频产生处理模块、所述视频转换处理模块集成在一个处理器中；或者所述第一采集模块、所述视频产生处理模块、所述视频转换处理模块其中两个集成在一个处理器中；或者所述第一采集模块、所述视频产生处理模块、所述视频转换处理模块单独设置。 The head mounted display according to claim 9, wherein the first acquisition module, the video generation processing module, and the video conversion processing module are integrated in one processor; or the first acquisition module The video generation processing module and the video conversion processing module are integrated into one processor; or the first acquisition module, the video generation processing module, and the video conversion processing module are separately set.
PCT/CN2017/093379 2017-07-18 2017-07-18 Method for detecting delay in head-mounted display data transmission, and head-mounted display WO2019014853A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/093379 WO2019014853A1 (en) 2017-07-18 2017-07-18 Method for detecting delay in head-mounted display data transmission, and head-mounted display
CN201780060304.9A CN109791297B (en) 2017-07-18 2017-07-18 Method for detecting data transmission delay of head-mounted display and head-mounted display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/093379 WO2019014853A1 (en) 2017-07-18 2017-07-18 Method for detecting delay in head-mounted display data transmission, and head-mounted display

Publications (1)

Publication Number Publication Date
WO2019014853A1 true WO2019014853A1 (en) 2019-01-24

Family

ID=65014872

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/093379 WO2019014853A1 (en) 2017-07-18 2017-07-18 Method for detecting delay in head-mounted display data transmission, and head-mounted display

Country Status (2)

Country Link
CN (1) CN109791297B (en)
WO (1) WO2019014853A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103200423A (en) * 2013-04-12 2013-07-10 江苏北方湖光光电有限公司 Delayed detection device of video picture processing system
CN103974020A (en) * 2013-02-06 2014-08-06 腾讯科技（深圳）有限公司 Audio-video data acquisition method and device
CN105452935A (en) * 2013-05-30 2016-03-30 欧库勒斯虚拟现实有限责任公司 Perception based predictive tracking for head mounted displays
CN105593924A (en) * 2013-12-25 2016-05-18 索尼公司 Image processing device, image processing method, computer program, and image display system
CN106331823A (en) * 2016-08-31 2017-01-11 北京奇艺世纪科技有限公司 Video playing method and device
US20170041897A1 (en) * 2013-11-12 2017-02-09 Qualcomm Incorporated Apparatus and methods for synchronizing a controller and sensors

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8994672B2 (en) * 2012-04-09 2015-03-31 Sony Corporation Content transfer via skin input

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103974020A (en) * 2013-02-06 2014-08-06 腾讯科技（深圳）有限公司 Audio-video data acquisition method and device
CN103200423A (en) * 2013-04-12 2013-07-10 江苏北方湖光光电有限公司 Delayed detection device of video picture processing system
CN105452935A (en) * 2013-05-30 2016-03-30 欧库勒斯虚拟现实有限责任公司 Perception based predictive tracking for head mounted displays
US20170041897A1 (en) * 2013-11-12 2017-02-09 Qualcomm Incorporated Apparatus and methods for synchronizing a controller and sensors
CN105593924A (en) * 2013-12-25 2016-05-18 索尼公司 Image processing device, image processing method, computer program, and image display system
CN106331823A (en) * 2016-08-31 2017-01-11 北京奇艺世纪科技有限公司 Video playing method and device

Also Published As

Publication number Publication date
CN109791297A (en) 2019-05-21
CN109791297B (en) 2021-07-20

Similar Documents

Publication Publication Date Title
CN107665698B (en) Ambient light intensity compensation method and device
CN109381165B (en) Skin detection method and mobile terminal
CN109217961B (en) Multi-channel human-computer interaction and human-computer environment test data synchronization device and method
CN106899766A (en) A kind of safety instruction method and its device and mobile terminal
CN104182049B (en) Non-contact type infrared two-dimensional gesture detection and recognition device and method
CN104103302A (en) Video and audio synchronous detection device and method
CN103606248A (en) Automatic detection method and system for human body falling-over
CN102169664A (en) Time delay detecting method and device of display device
CN108012026B (en) Eyesight protection method and mobile terminal
CN109994111B (en) Interaction method, interaction device and mobile terminal
WO2021017947A1 (en) Terminal control method and device, mobile terminal and storage medium
CN110505549A (en) The control method and device of earphone
CN106774889B (en) Gesture recognition method and device of wearable device
CN106470277A (en) A kind of safety instruction method and device
KR101619635B1 (en) Apparatus for selceting menu using eye tracking
WO2018094919A1 (en) Method and device for remotely and synchronously displaying writing
CN110677224B (en) Beam state detection method and terminal
CN115002295A (en) Image data synchronization method and device, terminal equipment and storage medium
CN110225196B (en) Terminal control method and terminal equipment
WO2019014853A1 (en) Method for detecting delay in head-mounted display data transmission, and head-mounted display
CN108521417B (en) Communication processing method and mobile terminal
CN103890592A (en) Electronic apparatus, portable terminal and speed measuring method
CN107562205B (en) Projection keyboard of intelligent terminal and operation method of projection keyboard
KR20180058580A (en) Method and apparatus for automatically setting detection range of radar
CN108040003B (en) Reminding method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17918612

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17918612

Country of ref document: EP

Kind code of ref document: A1