WO2019095090A1 - Procédé et dispositif de traitement de données - Google Patents

Procédé et dispositif de traitement de données Download PDF

Info

Publication number
WO2019095090A1
WO2019095090A1 PCT/CN2017/110784 CN2017110784W WO2019095090A1 WO 2019095090 A1 WO2019095090 A1 WO 2019095090A1 CN 2017110784 W CN2017110784 W CN 2017110784W WO 2019095090 A1 WO2019095090 A1 WO 2019095090A1
Authority
WO
WIPO (PCT)
Prior art keywords
acceleration
axial
angular
motion state
velocity
Prior art date
Application number
PCT/CN2017/110784
Other languages
English (en)
Chinese (zh)
Inventor
韩超
Original Assignee
深圳市柔宇科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市柔宇科技有限公司 filed Critical 深圳市柔宇科技有限公司
Priority to CN201780091767.1A priority Critical patent/CN110709803A/zh
Priority to PCT/CN2017/110784 priority patent/WO2019095090A1/fr
Publication of WO2019095090A1 publication Critical patent/WO2019095090A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to the field of smart wear technology, and in particular, to a data processing method and apparatus.
  • Head-mounted playback devices represented by virtual reality (VR) glasses are developing rapidly and become more and more popular. Head-mounted playback devices can provide users with excellent audio-visual enjoyment.
  • VR virtual reality
  • the processor of the head-mounted playback device receives and processes the motion data of the user's head from the sensor and presents the change. It takes a certain amount of time to get to the screen, causing a delay in the display. In a full-view screen such as VR, such delay can cause the user to feel dizzy.
  • the embodiment of the invention discloses a data processing method and device, which can synchronize the display screen with the movement state of the user's head, and effectively reduce the stun feeling when using the head mounted display device.
  • a first aspect of the embodiments of the present invention discloses a data processing method, including:
  • the motion state parameter is compensated according to a preset delay duration.
  • the display screen output by the head mounted display device is adjusted such that the display screen is synchronized with the motion state of the user's head.
  • a second aspect of the embodiments of the present invention discloses a data processing apparatus, including:
  • the obtaining module is configured to acquire a motion state parameter of the head of the user during the wearing of the head mounted display device.
  • the compensation module is configured to compensate the motion state parameter according to a preset delay duration.
  • an adjustment module configured to adjust a display screen output by the head mounted display device by using the compensated motion state parameter, so that the display screen is synchronized with a motion state of the user head.
  • a third aspect of embodiments of the present invention discloses a computer readable storage medium storing instructions that, when run on a computer, cause the computer to implement the data portion described in the first aspect above Method.
  • a fourth aspect of an embodiment of the present invention discloses a computer program product comprising instructions for causing a computer to implement the data processing method of the first aspect described above when it is run on a computer.
  • the motion state parameter of the head in the process of wearing the head mounted display device can be obtained by the user in the embodiment of the present invention, and the motion state parameter is compensated according to the preset delay duration, and the compensated motion state parameter is used to adjust
  • the display screen outputted by the head-mounted display device can synchronize the display screen with the movement state of the user's head, and effectively reduce the stun feeling when using the head-mounted display device.
  • FIG. 1 is a schematic flow chart of a data processing method according to an embodiment of the present invention.
  • FIG. 2a is a schematic diagram of a user's head movement disclosed in an embodiment of the present invention.
  • FIG. 2b is a schematic diagram of another user's head movement disclosed in the embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
  • the embodiment of the invention discloses a data processing method and device, which can synchronize the display screen with the movement state of the user's head, and effectively reduce the stun feeling when using the head mounted display device.
  • the head-mounted display device in the embodiment of the present invention may also be referred to as video glasses, a glasses-type display, a portable theater, etc., and can realize playback of multimedia files, including 3D images, 3D videos, and the like.
  • FIG. 1 is a schematic flowchart diagram of a data processing method according to an embodiment of the present invention.
  • the data processing method described in this embodiment includes:
  • the head mounted display device acquires a motion state parameter of a head of the user during wearing the head mounted display device.
  • the user is likely to move in the head during the process of wearing the head-mounted display device to view the display screen (such as 3D video).
  • the user wears the head-mounted display device to swing left or right, and of course, it can also swing forward or backward.
  • the user wears the head-mounted display ® to pan left or right, which of course can be forward or backward ⁇ .
  • the above-mentioned form of motion is only an example. In the actual application scenario, the user's head can perform any form of motion.
  • the embodiment of the present invention does not limit the specific motion form of the user's head.
  • the sensor configured by the head mounted display device can collect the motion state parameter of the head during the process of wearing the head mounted display device, and the processor of the head mounted display device reads the collected user from the sensor.
  • the motion state parameter of the head, or the sensor reports the motion state parameter of the collected user's head to the processor.
  • the motion state parameter may specifically include at least one of an angular velocity, an angular acceleration, an axial velocity, and an axial acceleration. As shown in FIG. 2a, the motion state parameter may specifically include an angular velocity ⁇ and an angular acceleration a ⁇ of the user when swinging the head. As further shown in FIG. 2b, the motion state parameter may specifically include the axial velocity v and the axial acceleration av of the user when the head is translated.
  • the motion of the user's head can generally be considered to include both the swinging head and the translational motion, that is, the motion state parameters specifically include: an angular velocity ⁇ and an angular acceleration a ⁇ corresponding to the oscillating weight, and a translation Corresponding axial velocity v and axial acceleration a v .
  • the sensor may specifically be a gravity sensor, a three-axis acceleration sensor, a gyroscope, or the like.
  • the head mounted display device compensates the motion state parameter according to a preset delay duration.
  • the preset delay duration specifically refers to the length of time from the movement of the user's head to the adjustment of the display screen of the head-mounted display device, that is, the length of time required for the user's head to move to the change of the motion to the display interface.
  • the specific value of the preset delay duration is mainly related to the performance of the processor and can be considered equal on the same type of processor.
  • the head-mounted display device acquires the motion state parameter and parses the motion state parameter, and then reflects the motion generated by the user's head on the display interface, the preset delay time needs to be occupied, if the direct use is
  • the motion state parameter acquired by the sensor adjusts the display screen output by the head mounted display device, so that the change of the display screen is likely to lag behind the motion state of the user's head, so that the head mounted display device can be based on the preset delay time.
  • compensating for the acquired motion state parameter that is, at least one of an angular velocity, an angular acceleration, an axial velocity, and an axial acceleration.
  • the head mounted display device adjusts the output display screen by using the compensated motion state parameter to synchronize the display screen with the motion state of the user's head.
  • the head-mounted display device adjusts the output display screen by using the compensated motion state parameter (angular speed and/or axial speed), so that the change of the display screen can keep up with the motion state of the user's head, thereby making The display screen is synchronized with the motion state of the user's head.
  • the compensated motion state parameter angular speed and/or axial speed
  • the motion state parameter may include an angular velocity ⁇ and an angular acceleration a ⁇
  • the angular velocity ⁇ may specifically include an angular velocity in a direction of three axes (ie, an X axis, a Y axis, and a Z axis), and an angular acceleration a ⁇
  • the angular acceleration in the three-axis ie, the X-axis, the Y-axis, and the Z-axis
  • the compensation of the angular velocity and/or the angular acceleration in a single axial direction will be described as an example.
  • the head mounted display device can compensate for the angular velocity ⁇ according to a preset delay duration (denoted as T delay ) and an angular acceleration a ⁇ .
  • T delay a preset delay duration
  • the angular acceleration is changing. If it is changing, the angular acceleration should be compensated first, and then the compensated angular acceleration is used to compensate the angular velocity to improve the accuracy of the diagonal velocity compensation. .
  • the head-mounted display device may first obtain the rate of change Ra ⁇ of the second angular acceleration a ⁇ 2 , according to the preset delay time T delay and the rate of change Ra ⁇ of the second angular acceleration a ⁇ 2 , to the first angle
  • the second angular acceleration a ⁇ 2 as the angular acceleration before the current time n ⁇ T, the rate of change of the second angular acceleration Ra ⁇ particular a ⁇ 2 may be a second preset angular acceleration a ⁇ 2
  • the motion state parameter may include an axial velocity v and an axial acceleration a v
  • the axial velocity v may specifically include three directions (ie, an X axis, a Y axis, and a Z axis) direction.
  • the axial velocity above, the axial acceleration a v may specifically include the axial acceleration in the direction of the three axes (ie, the X-axis, the Y-axis, and the Z-axis), and the embodiment of the present invention has an axial velocity in a single axial direction and/or
  • the compensation of the axial acceleration is explained as an example.
  • the head mounted display device can compensate for the axial velocity v according to a preset delay duration (denoted as T delay ) and an axial acceleration a v .
  • T delay a preset delay duration
  • the head-mounted display device may first obtain the rate of change Ra v of the second axial acceleration a v2 according to the preset rate of change of the delay time T delay and the second axial acceleration a v2 .
  • the second axial acceleration a v2 is an axial acceleration before the current time n ⁇ T
  • the change rate Ra v of the second axial acceleration a v2 may specifically be the second axial acceleration a V2 is an average rate of change Ra v within a predetermined statistical duration n ⁇ T
  • Ra v (a v1 -a v2 )/(n ⁇ T)
  • T is the processor reading the motion state parameter from the sensor Time interval
  • n is a positive integer.
  • the head mounted display device can acquire the motion state parameters of the head, such as angular velocity, angular acceleration, axial velocity, and axial acceleration, during the process of wearing the head mounted display device, according to preset
  • the delay time is used to compensate the motion state parameter
  • the compensated motion state parameter is used to adjust the display screen output by the head-mounted display device, so that the synchronization between the display screen and the user's head motion state can be realized, and the use head is effectively reduced. Dizziness when wearing a display device.
  • FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
  • the data processing apparatus described in this embodiment includes:
  • the obtaining module 301 is configured to acquire a motion state parameter of the head of the user during the wearing of the head mounted display device.
  • the compensation module 302 is configured to compensate the motion state parameter according to a preset delay duration.
  • the adjusting module 303 is configured to adjust a display screen output by the head mounted display device by using the compensated motion state parameter, so that the display screen is synchronized with a motion state of the user head.
  • the motion state parameter includes at least one of angular velocity, angular acceleration, axial velocity, and axial acceleration.
  • the motion state parameter includes the angular velocity and the angular acceleration
  • the compensation module 302 is specifically configured to:
  • the amount of compensation for the angular velocity is determined according to a preset delay duration and the angular acceleration.
  • the angular velocity is compensated by the amount of compensation of the angular velocity.
  • the angular acceleration includes a first angular acceleration that is currently acquired and a second angular acceleration that is acquired in advance
  • the compensation module 302 is specifically configured to:
  • the first angular acceleration changes relative to the second angular acceleration
  • the first angular acceleration is compensated according to a preset delay duration and a rate of change of the second angular acceleration.
  • the rate of change of the second angular acceleration is an average rate of change of the second angular acceleration over a predetermined statistical time period.
  • the motion state parameter includes the axial velocity and the axial acceleration
  • the compensation module 302 is specifically configured to:
  • the amount of compensation for the axial velocity is determined based on a preset delay duration and the axial acceleration.
  • the axial velocity is compensated by the amount of compensation of the axial velocity.
  • the axial acceleration includes a first axial acceleration currently acquired and a second axial acceleration acquired in advance
  • the compensation module 302 is specifically configured to:
  • the first axial acceleration changes relative to the second axial acceleration
  • the first axial acceleration is compensated according to a preset delay duration and a rate of change of the second axial acceleration.
  • the rate of change of the second axial acceleration is an average rate of change of the second axial acceleration over a predetermined statistical time period.
  • the preset delay duration is a length of time elapsed from movement of the user's head to adjustment of the display screen.
  • the acquiring module 301 can obtain the motion state parameter of the head in the process of wearing the head mounted display device, and the compensation module 302 compensates the motion state parameter according to the preset delay duration, and the adjusting module 303
  • the compensated motion state parameter and adjusting the display screen output by the head-mounted display device By using the compensated motion state parameter and adjusting the display screen output by the head-mounted display device, synchronization between the display screen and the movement state of the user's head can be realized, and the stun feeling when using the head-mounted display device is effectively reduced.
  • the embodiment of the invention further provides a computer readable storage medium, characterized in that the storage medium stores instructions, when it is run on a computer, causes the computer to implement the above method embodiment.
  • Embodiments of the present invention also provide a computer program product comprising instructions that, when run on a computer, cause the computer to implement the above-described method embodiments.
  • the program may be stored in a computer readable storage medium, and the storage medium may include: Flash disk, Read-Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne un procédé et un dispositif de traitement de données. Le procédé comprend les étapes consistant : à acquérir un paramètre d'état de mouvement de la tête d'un utilisateur portant un visiocasque, à compenser le paramètre d'état de mouvement sur la base d'une longueur prédéfinie de temps de retard, et à utiliser le paramètre d'état de mouvement compensé pour régler une image affichée délivrée en sortie par le visiocasque. Des modes de réalisation de la présente invention mettent en œuvre la synchronisation de l'image affichée et de l'état de mouvement de la tête de l'utilisateur et réduisent efficacement la vertige lors de l'utilisation du visiocasque.
PCT/CN2017/110784 2017-11-14 2017-11-14 Procédé et dispositif de traitement de données WO2019095090A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780091767.1A CN110709803A (zh) 2017-11-14 2017-11-14 数据处理方法及装置
PCT/CN2017/110784 WO2019095090A1 (fr) 2017-11-14 2017-11-14 Procédé et dispositif de traitement de données

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/110784 WO2019095090A1 (fr) 2017-11-14 2017-11-14 Procédé et dispositif de traitement de données

Publications (1)

Publication Number Publication Date
WO2019095090A1 true WO2019095090A1 (fr) 2019-05-23

Family

ID=66538413

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/110784 WO2019095090A1 (fr) 2017-11-14 2017-11-14 Procédé et dispositif de traitement de données

Country Status (2)

Country Link
CN (1) CN110709803A (fr)
WO (1) WO2019095090A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8970495B1 (en) * 2012-03-09 2015-03-03 Google Inc. Image stabilization for color-sequential displays
CN105872698A (zh) * 2016-03-31 2016-08-17 宇龙计算机通信科技(深圳)有限公司 播放方法、播放系统和虚拟现实终端
CN106164744A (zh) * 2014-03-27 2016-11-23 微软技术许可有限责任公司 头戴式显示器相对运动补偿
CN106773047A (zh) * 2016-12-27 2017-05-31 上海与德信息技术有限公司 一种基于vr装置的显示方法及系统
CN107003512A (zh) * 2014-12-30 2017-08-01 索尼互动娱乐股份有限公司 用于虚拟现实的头戴式显示器中的扫描显示系统
CN107145219A (zh) * 2016-03-01 2017-09-08 腾讯科技（深圳）有限公司 一种显示调整的方法以及显示调整装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9917591D0 (en) * 1999-07-28 1999-09-29 Marconi Electronic Syst Ltd Head tracker system
WO2001022149A1 (fr) * 1999-09-22 2001-03-29 Canadian Space Agency Procede et systeme de correction de temps/mouvement pour des affichages montes sur la tete
CN100478849C (zh) * 2007-04-10 2009-04-15 南京航空航天大学 基于多加速度传感器的虚拟现实头盔防眩晕系统及方法
CN205581842U (zh) * 2016-03-31 2016-09-14 小派科技（上海）有限责任公司 一种基于头戴式显示器的显示系统
CN106658170A (zh) * 2016-12-20 2017-05-10 福州瑞芯微电子股份有限公司 一种降低虚拟现实延迟的方法和装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8970495B1 (en) * 2012-03-09 2015-03-03 Google Inc. Image stabilization for color-sequential displays
CN106164744A (zh) * 2014-03-27 2016-11-23 微软技术许可有限责任公司 头戴式显示器相对运动补偿
CN107003512A (zh) * 2014-12-30 2017-08-01 索尼互动娱乐股份有限公司 用于虚拟现实的头戴式显示器中的扫描显示系统
CN107145219A (zh) * 2016-03-01 2017-09-08 腾讯科技（深圳）有限公司 一种显示调整的方法以及显示调整装置
CN105872698A (zh) * 2016-03-31 2016-08-17 宇龙计算机通信科技(深圳)有限公司 播放方法、播放系统和虚拟现实终端
CN106773047A (zh) * 2016-12-27 2017-05-31 上海与德信息技术有限公司 一种基于vr装置的显示方法及系统

Also Published As

Publication number Publication date
CN110709803A (zh) 2020-01-17

Similar Documents

Publication Publication Date Title
RU2638776C1 (ru) Устройство генерирования изображения и способ
JP2024059761A (ja) 仮想現実および拡張現実ディスプレイシステムのための連続時間ワーピングおよび両眼時間ワーピングおよび方法
JP2021122109A (ja) 単一深度追跡型の遠近調節−両眼転導ソリューション
TWI454129B (zh) 顯示觀看系統及基於主動追蹤用於最佳化顯示觀看之方法
WO2019026765A1 (fr) Dispositif de rendu, visiocasque, procédé de transmission d'image, et procédé de correction d'image
CN111656433B (zh) 减轻头戴式显示器中动显延迟的装置、系统和方法
WO2019037365A1 (fr) Procédé et dispositif de projection de flux vidéo panoramique de réalité virtuelle
CN105894567B (zh) 放缩三维场景中的用户控制的虚拟对象的像素深度值
US20170366803A1 (en) System and method for capturing and viewing panoramic images having motion parallax depth perception without image stitching
CN105812768B (zh) 一种3d视频在vr设备中的播放方法及系统
CN106296781B (zh) 特效图像生成方法及电子设备
WO2013018262A1 (fr) Dispositif de formation d'image, dispositif de traitement de données, procédé de traitement de données et procédé pour synchroniser la sortie de données de trame
CN104021585A (zh) 基于真实场景的三维展示方法
CN111902842A (zh) 在头戴式显示器中实现帧内图像处理的装置、系统和方法
CN108107578A (zh) 虚拟现实的视角调节方法、装置、计算设备及存储介质
WO2019098198A1 (fr) Dispositif, système et procédé de génération d'images, visiocasque et programme associé
CN108989784A (zh) 虚拟现实设备的图像显示方法、装置、设备及存储介质
CN110691231A (zh) 一种虚拟现实播放系统及其同步播放方法
WO2019095090A1 (fr) Procédé et dispositif de traitement de données
JP2023055773A (ja) 同期制御装置、同期制御方法、及びプログラム
WO2022099787A1 (fr) Dispositif d'affichage monté sur la tête et procédé d'acquisition de données, appareil et ordinateur hôte associés
CN106713893B (zh) 手机3d立体拍照方法
US11948242B2 (en) Intelligent smoothing of 3D alternative reality applications for secondary 2D viewing
JP2019074881A (ja) 画像生成装置および画像生成方法
JP7047085B2 (ja) 画像生成装置、画像生成方法、およびプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17932512

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17932512

Country of ref document: EP

Kind code of ref document: A1