WO2017120766A1 - Procédé et appareil de traitement d'interruption de données de capteur de dispositif d'affichage de tête - Google Patents

Procédé et appareil de traitement d'interruption de données de capteur de dispositif d'affichage de tête Download PDF

Info

Publication number
WO2017120766A1
WO2017120766A1 PCT/CN2016/070680 CN2016070680W WO2017120766A1 WO 2017120766 A1 WO2017120766 A1 WO 2017120766A1 CN 2016070680 W CN2016070680 W CN 2016070680W WO 2017120766 A1 WO2017120766 A1 WO 2017120766A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile phone
sensor data
head
display device
module
Prior art date
Application number
PCT/CN2016/070680
Other languages
English (en)
Chinese (zh)
Inventor
李刚
龙寿伦
Original Assignee
深圳多哚新技术有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳多哚新技术有限责任公司 filed Critical 深圳多哚新技术有限责任公司
Priority to PCT/CN2016/070680 priority Critical patent/WO2017120766A1/fr
Publication of WO2017120766A1 publication Critical patent/WO2017120766A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to the field of head display devices, and in particular, to a method and apparatus for processing sensor data interruption of a head display device.
  • the head-mounted devices In the field of virtual reality, users need to wear head-mounted devices to experience virtual reality. The most important part is the part of head tracking. During the rotation of the user's head, the virtual scene can be rotated together. This requires sensors to sense the head. Part gesture.
  • the main sensors used are angular velocity meters (gyros), accelerometers, and geomagnetic sensors. According to the original values of these sensors, the current head pose can be obtained through algorithm processing.
  • the sensor data of the head-mounted device mainly comes from two kinds, one is a self-contained motion sensor, and the other is a sensor directly using a mobile phone. Since the mobile phone is not specifically used for virtual reality, its head tracking effect is relatively poor, so some head-mounted devices have their own motion sensors.
  • the sensor data needs to be transmitted to the mobile phone through the data communication for processing. Due to the instability of the data communication, the data may be interrupted, and the head posture data is not real-time. Updates result in poor user experience.
  • the embodiment of the invention provides a method and a device for processing sensor data interruption of the head display device, which can solve the problem that the head posture data cannot be updated in real time when the data communication between the head display device and the mobile phone is interrupted.
  • processing method further includes:
  • the method further includes:
  • the mobile phone acquires the self-banding sensor data of the head display device in real time, the mobile phone is controlled to switch to use the self-contained sensor data for head tracking.
  • processing method further includes:
  • processing method further includes:
  • the head display device When the number of alarms exceeds a preset third threshold, the head display device is controlled to suspend operation.
  • a real-time detection module configured to detect in real time whether the mobile phone does not obtain the self-contained sensor data of the head display device within a preset time
  • the self-contained module is configured to control, when the detection result of the real-time detection module is negative, the mobile phone to perform head tracking by using the self-contained sensor data;
  • the mobile phone module is configured to control the mobile phone to perform head tracking by using the mobile phone sensor data when the detection result of the real-time detection module is YES.
  • the processing device further includes:
  • a first determining module configured to determine whether a duration of the head tracking by the mobile phone using the mobile phone sensor data exceeds a preset first threshold
  • the first alarm module is configured to alarm when the determination result of the first determining module is YES.
  • the processing device further includes:
  • a switching module configured to: after the mobile phone module controls the mobile phone to perform head tracking by using the mobile phone sensor data, if the real-time detecting module detects in real time that the mobile phone acquires the self-sensor data of the display device, Controlling the mobile phone to switch to use the self-contained sensor data for head tracking;
  • a second determining module configured to determine whether the number of times the mobile phone is switched within a preset duration exceeds a preset second threshold
  • the second alarm module is configured to: when the judgment result of the second judging module is YES, alarm.
  • the processing device further includes:
  • the head display device includes the above processing device.
  • the head display device automatically transmits data to the mobile phone
  • the data is interrupted, and the mobile phone can use the mobile phone sensor data to perform head tracking, thereby avoiding the user experience effect that the head posture data cannot be updated in real time. Poor question.
  • FIG. 1 is a flow chart of an embodiment of a method for processing sensor data interruption of a head display device according to an embodiment of the present invention
  • FIG. 2 is a flow chart of another embodiment of a method for processing sensor data interruption of a head display device according to an embodiment of the present invention
  • FIG. 3 is a structural diagram of an embodiment of a processing device for interrupting sensor data of a head display device according to an embodiment of the present invention
  • FIG. 4 is a structural diagram of another embodiment of a processing device for interrupting sensor data of a head display device according to an embodiment of the present invention.
  • the embodiment of the invention provides a method and a device for processing sensor data interruption of a head display device, which are used for solving the problem that the head posture data cannot be updated in real time when the data communication between the head display device and the mobile phone is interrupted.
  • an embodiment of a method for processing sensor data interruption of a head display device includes:
  • step 101 real-time detection of the mobile phone does not obtain the self-contained sensor data of the head-mounted device within a preset time, if not, proceed to step 102, and if so, proceed to step 103;
  • step 102 it is detected in real time whether the mobile phone acquires the self-contained sensor data of the head display device. If not, step 102 is performed, and if yes, step 103 is performed.
  • the mobile phone can control the mobile phone to perform head tracking using the self-contained sensor data.
  • the mobile phone sensor data can be controlled to perform head tracking.
  • the real-time detecting whether the mobile phone does not acquire the self-contained sensor data of the head-display device within a preset time, and if not, controlling the mobile phone to perform head tracking using the self-contained sensor data, and if so, controlling the The phone uses mobile phone sensor data for head tracking.
  • the head-display device transmits data to the mobile phone the data is interrupted, and the mobile phone can use the mobile phone sensor data to perform head tracking, thereby avoiding poor user experience when the head posture data is not updated in real time. The problem.
  • step 201 real-time detection of the mobile phone does not obtain the self-contained sensor data of the head-mounted device within a preset time, if not, proceed to step 202, and if so, proceed to step 203;
  • step 202 In order to ensure the stable operation of the head-mounted device and the good user experience, it is necessary to detect in real time whether the mobile phone does not obtain the self-contained sensor data of the head-mounted device within a preset time. If not, go to step 202, and if yes, perform the steps. 203.
  • the real-time detection finds that the mobile phone cannot obtain the self-contained sensor data of the head-display device, it can be known that the data communication between the self-contained sensor and the mobile phone on the head-display device is interrupted, and in order to ensure user experience, the head is avoided. If the gesture is not updated in real time, the mobile phone sensor data can be controlled to perform head tracking.
  • step 207 can be performed to perform an alarm operation to inform the user to perform maintenance on the head display device in time.
  • the normal flow is performed according to the normal process, and the normal flow is not limited herein.
  • the mobile phone After controlling the mobile phone to use the mobile phone sensor data for head tracking, if the mobile phone detects the self-contained sensor data of the display device again, the mobile phone is controlled to switch to use the self-contained sensor data for head tracking.
  • the head posture obtained from the sensor data is more accurate and the user experience is better.
  • step 206 Determine whether the number of times of switching of the mobile phone exceeds a preset second threshold within a preset duration. If yes, execute step 207. If not, execute according to a normal process.
  • step 207 it is also determined whether the number of times the mobile phone is switched within the preset time period exceeds a preset second threshold. If yes, step 207 is performed, and if not, the process is performed according to a normal process. It can be understood that if the number of times of switching of the mobile phone exceeds a preset second threshold within a preset duration, it can be considered that the mobile phone is switched too frequently, that is, the data communication between the self-contained sensor and the mobile phone is extremely unstable, and the data interruption rate is Too high, so an alarm should be issued to allow the user to detect and maintain the head display device as soon as possible.
  • the number of alarms exceeds the preset third threshold, it can be understood that the frequency of communication between the self-contained sensor and the mobile phone is very high. At this time, if the head-mounted device is continuously activated, it is likely to be impossible for the head-mounted device. The damage recovered, so the head-mounted device should be controlled to suspend work for maintenance as soon as possible.
  • a processing device for interrupting the sensor data of the head display device will be described in detail below.
  • a head display device sensor is used in the embodiment of the present invention.
  • An embodiment of a processing device for data interruption includes:
  • the real-time detecting module 301 is configured to detect, in real time, whether the mobile phone does not obtain the self-contained sensor data of the head display device within a preset time;
  • the self-contained module 302 is configured to control the mobile phone to perform head tracking by using the self-contained sensor data when the detection result of the real-time detecting module 301 is negative;
  • the mobile phone module 303 is configured to control the mobile phone to perform head tracking by using the mobile phone sensor data when the detection result of the real-time detection module 301 is YES.
  • the real-time detecting module 301 detects in real time whether the mobile phone does not acquire the self-contained sensor data of the head-display device within a preset time; when the detection result of the real-time detecting module 301 is negative, the self-contained module 302 controls The mobile phone uses the self-contained sensor data for head tracking; when the detection result of the real-time detecting module 301 is YES, the mobile phone module 303 is used to control the mobile phone to perform head tracking using the mobile phone sensor data.
  • the head-display device transmits data to the mobile phone
  • the data is interrupted, and the mobile phone can use the mobile phone sensor data to perform head tracking, thereby avoiding poor user experience when the head posture data is not updated in real time. The problem.
  • FIG. 4 another embodiment of a processing device for interrupting sensor data of the head display device is provided in the embodiment of the present invention. Examples include:
  • the real-time detecting module 401 is configured to detect, in real time, whether the mobile phone does not obtain the self-contained sensor data of the head-display device within a preset time;
  • the self-contained module 402 is configured to control the mobile phone to perform head tracking by using the self-contained sensor data when the detection result of the real-time detecting module 401 is negative;
  • the mobile phone module 403 is configured to control the mobile phone to perform head tracking by using the mobile phone sensor data when the detection result of the real-time detection module 401 is YES.
  • the first determining module 404 is configured to determine whether the duration of the head tracking by the mobile phone using the mobile phone sensor data exceeds a preset first threshold
  • the first alarm module 405 is configured to alarm when the determination result of the first determining module 404 is YES.
  • the switching module 406 is configured to control, after the mobile phone module 403 controls the mobile phone to use the mobile phone sensor data for head tracking, if the real-time detecting module 401 detects that the mobile phone acquires the self-sensor data of the display device, The mobile phone switches to use the self-contained sensor data for head tracking;
  • the second determining module 407 is configured to determine whether the number of times the mobile phone is switched over the preset duration exceeds a preset second threshold
  • the second alarm module 408 is configured to alarm when the determination result of the second determining module 407 is YES.
  • the pause working module 409 is configured to control the head display device to pause when the number of alarms exceeds a preset third threshold.
  • the present invention further provides a head display device including a processing device for interrupting sensor data of any of the head display devices as described in FIG. 3 or FIG. 4.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated Go to another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)

Abstract

L'invention concerne un procédé de traitement d'interruption de données de capteur de dispositif d'affichage de tête, un appareil associé et un dispositif d'affichage de tête, utilisés pour résoudre le problème de données d'attitude de tête ne pouvant pas être mises à jour en temps réel lorsque la communication de données entre un capteur intégré du dispositif d'affichage de tête et un téléphone mobile est interrompue. Le procédé consiste : à détecter, en temps réel, si un téléphone mobile n'obtient pas de données de capteur intégré du dispositif d'affichage de tête dans un temps prédéterminé (101), si tel n'est pas le cas, à commander le téléphone mobile de façon à utiliser les données de capteur intégré pour effectuer le suivi de tête (102) et, si tel est le cas, à commander le téléphone mobile de façon à utiliser des données de capteur de téléphone mobile pour effectuer le suivi de tête (103).
PCT/CN2016/070680 2016-01-12 2016-01-12 Procédé et appareil de traitement d'interruption de données de capteur de dispositif d'affichage de tête WO2017120766A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/070680 WO2017120766A1 (fr) 2016-01-12 2016-01-12 Procédé et appareil de traitement d'interruption de données de capteur de dispositif d'affichage de tête

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/070680 WO2017120766A1 (fr) 2016-01-12 2016-01-12 Procédé et appareil de traitement d'interruption de données de capteur de dispositif d'affichage de tête

Publications (1)

Publication Number Publication Date
WO2017120766A1 true WO2017120766A1 (fr) 2017-07-20

Family

ID=59310683

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/070680 WO2017120766A1 (fr) 2016-01-12 2016-01-12 Procédé et appareil de traitement d'interruption de données de capteur de dispositif d'affichage de tête

Country Status (1)

Country Link
WO (1) WO2017120766A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113687048A (zh) * 2021-07-01 2021-11-23 精英数智科技股份有限公司 传感器数据检测中断识别方法、装置及电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120064951A1 (en) * 2010-09-13 2012-03-15 Sony Ericsson Mobile Communications Ab Hands-Free Control of Mobile Communication Device Based on Head Movement
CN104931055A (zh) * 2015-06-09 2015-09-23 西安交通大学 一种基于微环境感知的蓝牙防丢检测导航方法及其系统
CN105117144A (zh) * 2015-07-31 2015-12-02 上海海漾软件技术有限公司 一种基于移动终端的提醒方法及装置
CN105206003A (zh) * 2015-10-12 2015-12-30 上海摩软通讯技术有限公司 移动终端、报警方法及系统
CN105209959A (zh) * 2013-03-14 2015-12-30 高通股份有限公司 用于头戴式显示器的用户界面
CN105700684A (zh) * 2016-01-12 2016-06-22 深圳多哚新技术有限责任公司 一种头显设备传感器数据中断的处理方法和装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120064951A1 (en) * 2010-09-13 2012-03-15 Sony Ericsson Mobile Communications Ab Hands-Free Control of Mobile Communication Device Based on Head Movement
CN105209959A (zh) * 2013-03-14 2015-12-30 高通股份有限公司 用于头戴式显示器的用户界面
CN104931055A (zh) * 2015-06-09 2015-09-23 西安交通大学 一种基于微环境感知的蓝牙防丢检测导航方法及其系统
CN105117144A (zh) * 2015-07-31 2015-12-02 上海海漾软件技术有限公司 一种基于移动终端的提醒方法及装置
CN105206003A (zh) * 2015-10-12 2015-12-30 上海摩软通讯技术有限公司 移动终端、报警方法及系统
CN105700684A (zh) * 2016-01-12 2016-06-22 深圳多哚新技术有限责任公司 一种头显设备传感器数据中断的处理方法和装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113687048A (zh) * 2021-07-01 2021-11-23 精英数智科技股份有限公司 传感器数据检测中断识别方法、装置及电子设备

Similar Documents

Publication Publication Date Title
US10338673B2 (en) Touchscreen hover detection in an augmented and/or virtual reality environment
EP3400506B1 (fr) Techniques de modification d'emplacements d'objets dans un système de réalité virtuelle/augmentée
US20170103574A1 (en) System and method for providing continuity between real world movement and movement in a virtual/augmented reality experience
US20170372499A1 (en) Generating visual cues related to virtual objects in an augmented and/or virtual reality environment
US10191603B2 (en) Information processing device and information processing method
EP3548995B1 (fr) Fin de session dans un environnement de réalité augmentée et/ou virtuelle
US10694018B2 (en) Method and apparatus for controlling running status of wearable electronic device
US20210064126A1 (en) Interface Interaction Apparatus and Method
US20180011456A1 (en) Method and apparatus for smart home control based on smart watches
WO2018072339A1 (fr) Casque de réalité virtuelle et procédé de commutation d'informations d'affichage de casque de réalité virtuelle
WO2017113862A1 (fr) Procédé et dispositif de visualisation de vidéo sur la base d'un casque de réalité virtuelle
WO2018039070A1 (fr) Système et procédé de placement de personnages virtuels dans un environnement de réalité augmentée/virtuelle
WO2020108101A1 (fr) Procédé et appareil de traitement de données virtuelles, et support de stockage, et terminal
CN107844215A (zh) 防误触方法、系统及装置
CN104991723A (zh) 一种横竖屏切换系统及方法
WO2017120766A1 (fr) Procédé et appareil de traitement d'interruption de données de capteur de dispositif d'affichage de tête
EP3264413B1 (fr) Système et procédé de traitement d'informations
US20150228255A1 (en) Electronic apparatus and control method for the same
CN104951038A (zh) 操作便携计算装置的节能方法
CN105700684A (zh) 一种头显设备传感器数据中断的处理方法和装置
US10409464B2 (en) Providing a context related view with a wearable apparatus
US20210357017A1 (en) Motion matching in virtual environments
JP7227975B2 (ja) 情報通信システム、端末装置、及び情報通信システムの作動方法
US20160011677A1 (en) Angle-based item determination methods and systems
WO2018008208A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et programme

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16884329

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.11.18)

122 Ep: pct application non-entry in european phase

Ref document number: 16884329

Country of ref document: EP

Kind code of ref document: A1