BR112019001320A2 - sistemas e métodos para redução de latência de movimento para fóton e largura de banda de memória em um sistema de realidade virtual - Google Patents

sistemas e métodos para redução de latência de movimento para fóton e largura de banda de memória em um sistema de realidade virtual

Info

Publication number
BR112019001320A2
BR112019001320A2 BR112019001320-2A BR112019001320A BR112019001320A2 BR 112019001320 A2 BR112019001320 A2 BR 112019001320A2 BR 112019001320 A BR112019001320 A BR 112019001320A BR 112019001320 A2 BR112019001320 A2 BR 112019001320A2
Authority
BR
Brazil
Prior art keywords
virtual reality
methods
memory bandwidth
acceleration
sensor data
Prior art date
Application number
BR112019001320-2A
Other languages
English (en)
Inventor
Quach Nhon
Khan Moinul
Ribble Maurice
Tavakoli Mehrad
Kulkarni Rashmi
Wai Kit Yuen Ricky
Lemoine Todd
Renschler Martin
Original Assignee
Qualcomm Incorporated
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Incorporated filed Critical Qualcomm Incorporated
Publication of BR112019001320A2 publication Critical patent/BR112019001320A2/pt

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0147—Head-up displays characterised by optical features comprising a device modifying the resolution of the displayed image
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)
  • Digital Computer Display Output (AREA)

Abstract

a presente invenção refere-se a sistemas, métodos e programas de computador para reduzir a latência de movimento para fóton e a largura de banda de memória em um sistema de exibição de realidade virtual. um método exemplificativo envolve receber dados de sensor de um ou mais sensores que rastreiam o movimento translacional e rotacional de um usuário para um aplicativo de realidade virtual. uma posição atualizada do usuário é calculada com base nos dados de sensor recebidos. a velocidade e a aceleração do movimento de usuário podem ser calculadas com base nos dados de sensor. a posição atualizada, a velocidade e a aceleração podem ser fornecidas a um mecanismo de distorção configurado para atualizar uma imagem renderizada antes do envio a uma exibição de realidade virtual com base em uma ou mais dentre a posição atualizada, a velocidade e a aceleração.
BR112019001320-2A 2016-07-29 2017-06-29 sistemas e métodos para redução de latência de movimento para fóton e largura de banda de memória em um sistema de realidade virtual BR112019001320A2 (pt)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662368241P 2016-07-29 2016-07-29
US62/368,241 2016-07-29
US15/253,201 2016-08-31
US15/253,201 US9858637B1 (en) 2016-07-29 2016-08-31 Systems and methods for reducing motion-to-photon latency and memory bandwidth in a virtual reality system
PCT/US2017/040080 WO2018022250A1 (en) 2016-07-29 2017-06-29 Systems and methods for reducing motion-to-photon latency and memory bandwidth in a virtual reality system

Publications (1)

Publication Number Publication Date
BR112019001320A2 true BR112019001320A2 (pt) 2019-05-07

Family

ID=60788960

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112019001320-2A BR112019001320A2 (pt) 2016-07-29 2017-06-29 sistemas e métodos para redução de latência de movimento para fóton e largura de banda de memória em um sistema de realidade virtual

Country Status (7)

Country Link
US (1) US9858637B1 (pt)
EP (1) EP3491489B1 (pt)
JP (1) JP6556973B1 (pt)
KR (1) KR101979564B1 (pt)
CN (1) CN109564466B (pt)
BR (1) BR112019001320A2 (pt)
WO (1) WO2018022250A1 (pt)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10600245B1 (en) 2014-05-28 2020-03-24 Lucasfilm Entertainment Company Ltd. Navigating a virtual environment of a media content item
WO2017044795A1 (en) * 2015-09-10 2017-03-16 Google Inc. Playing spherical video on a limited bandwidth connection
US10962780B2 (en) * 2015-10-26 2021-03-30 Microsoft Technology Licensing, Llc Remote rendering for virtual images
CN110573929A (zh) * 2017-05-01 2019-12-13 无限增强现实以色列有限公司 增强或混合现实环境的光学引擎时间扭曲
US20180329465A1 (en) * 2017-05-11 2018-11-15 Qualcomm Incorporated System and method for intelligent adjustment of an immersive multimedia workload in a portable computing device
US10496579B2 (en) * 2017-11-13 2019-12-03 Bobby Gene Burrough Graphics processing unit with sensor interface
US10706813B1 (en) 2018-02-03 2020-07-07 Facebook Technologies, Llc Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays
US10559276B2 (en) 2018-02-03 2020-02-11 Facebook Technologies, Llc Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays
US10818086B2 (en) * 2018-02-09 2020-10-27 Lenovo (Singapore) Pte. Ltd. Augmented reality content characteristic adjustment
US10796407B2 (en) 2018-05-11 2020-10-06 Samsung Electronics Co., Ltd. Foveated domain storage and processing
US10678325B2 (en) 2018-05-22 2020-06-09 Facebook Technologies, Llc Apparatus, system, and method for accelerating positional tracking of head-mounted displays
CN108632598A (zh) * 2018-05-25 2018-10-09 小派科技（上海）有限责任公司 降低vr设备mtp延时的方法及装置
US10388255B2 (en) * 2018-06-29 2019-08-20 Intel Corporation Computers for supporting multiple virtual reality display devices and related methods
WO2020139758A1 (en) * 2018-12-28 2020-07-02 Magic Leap, Inc. Low motion-to-photon latency architecture for augmented and virtual reality display systems
JP7457714B2 (ja) 2018-12-28 2024-03-28 マジック リープ， インコーポレイテッド 機械的に作動される画像プロジェクタを伴う可変ピクセル密度ディスプレイシステム
US20200387217A1 (en) * 2019-06-07 2020-12-10 Eyetech Digital Systems, Inc. Devices and Methods For Reducing Computational and Transmission Latencies In Cloud Based Eye Tracking Systems
KR102261993B1 (ko) * 2019-08-20 2021-06-07 주식회사 엘지유플러스 가상 현실 영상 제공 방법
US20210192681A1 (en) * 2019-12-18 2021-06-24 Ati Technologies Ulc Frame reprojection for virtual reality and augmented reality
WO2022050734A1 (en) * 2020-09-03 2022-03-10 Samsung Electronics Co., Ltd. Method and device for reducing performance difference between contents and devices in communication system
EP4059581A1 (en) * 2021-03-16 2022-09-21 Deutsche Telekom AG Method and system to reduce vr sickness in a cloud game service
US11822713B2 (en) * 2021-06-11 2023-11-21 Rockwell Collins, Inc. Pose augmentation of head worn display video for latency reduction
US11652513B2 (en) 2021-08-17 2023-05-16 Cisco Technology, Inc. Wireless reliability for devices in motion
CN114167992A (zh) * 2021-12-17 2022-03-11 深圳创维数字技术有限公司 显示画面渲染方法、电子设备及可读存储介质
US12002168B2 (en) * 2022-06-20 2024-06-04 Snap Inc. Low latency hand-tracking in augmented reality systems
WO2024063253A1 (ko) * 2022-09-23 2024-03-28 삼성전자주식회사 카메라로부터 획득한 이미지 내에 포함된 복수의 영역들 각각의 해상도들을 제어하기 위한 전자 장치 및 그 방법

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6801989B2 (en) * 2001-06-28 2004-10-05 Micron Technology, Inc. Method and system for adjusting the timing offset between a clock signal and respective digital signals transmitted along with that clock signal, and memory device and computer system using same
US7683188B2 (en) 2004-04-26 2010-03-23 TEVA Gyógyszergyár Zártkōrūen Mūkōdō Részvénytársaság Process for preparation of mycophenolic acid and ester derivatives thereof
CN1993688B (zh) * 2004-08-03 2012-01-18 西尔弗布鲁克研究有限公司 走近启动的打印
US7483806B1 (en) 2007-07-20 2009-01-27 International Business Machines Corporation Design structures, method and systems of powering on integrated circuit
JP5388534B2 (ja) * 2008-10-09 2014-01-15 キヤノン株式会社 画像処理装置およびその方法、頭部装着型ディスプレイ、プログラム、記録媒体
US8294723B2 (en) * 2008-11-07 2012-10-23 Google Inc. Hardware-accelerated graphics for web applications using native code modules
US9024972B1 (en) * 2009-04-01 2015-05-05 Microsoft Technology Licensing, Llc Augmented reality computing with inertial sensors
US9400695B2 (en) * 2010-02-26 2016-07-26 Microsoft Technology Licensing, Llc Low latency rendering of objects
US20110242427A1 (en) * 2010-04-01 2011-10-06 Timothy Ramsdale Method and System for Providing 1080P Video With 32-Bit Mobile DDR Memory
US9898866B2 (en) 2013-03-13 2018-02-20 The University Of North Carolina At Chapel Hill Low latency stabilization for head-worn displays
CN105980965A (zh) * 2013-10-10 2016-09-28 视力移动科技公司 用于非接触式打字的系统、设备和方法
US9412332B2 (en) * 2013-12-20 2016-08-09 Blackberry Limited Method for wirelessly transmitting content from a source device to a sink device
US9529195B2 (en) * 2014-01-21 2016-12-27 Osterhout Group, Inc. See-through computer display systems
US9766463B2 (en) * 2014-01-21 2017-09-19 Osterhout Group, Inc. See-through computer display systems
CN112651288B (zh) 2014-06-14 2022-09-20 奇跃公司 用于产生虚拟和增强现实的方法和系统
US20150370322A1 (en) * 2014-06-18 2015-12-24 Advanced Micro Devices, Inc. Method and apparatus for bezel mitigation with head tracking
US20160027141A1 (en) * 2014-07-22 2016-01-28 Oculus Vr, Llc In-band latency detection system
US9659410B2 (en) 2014-10-21 2017-05-23 Honeywell International Inc. Low latency augmented reality display
JP6526051B2 (ja) * 2014-12-12 2019-06-05 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム
US9240069B1 (en) 2015-06-30 2016-01-19 Ariadne's Thread (Usa), Inc. Low-latency virtual reality display system

Also Published As

Publication number Publication date
KR20190015577A (ko) 2019-02-13
CN109564466B (zh) 2020-08-25
JP2019532375A (ja) 2019-11-07
CN109564466A (zh) 2019-04-02
EP3491489A1 (en) 2019-06-05
WO2018022250A1 (en) 2018-02-01
EP3491489B1 (en) 2023-04-05
US9858637B1 (en) 2018-01-02
KR101979564B1 (ko) 2019-05-16
JP6556973B1 (ja) 2019-08-07

Similar Documents

Publication Publication Date Title
BR112019001320A2 (pt) sistemas e métodos para redução de latência de movimento para fóton e largura de banda de memória em um sistema de realidade virtual
MX2021010979A (es) Desplazamiento guiado por realidad en realidad virtual.
EP4123424A3 (en) Sensory enhanced augmented reality and virtual reality device
WO2016153628A3 (en) Augmented reality content creation
BR112018016726A2 (pt) dispositivo de exibição usado na cabeça para realidade virtual e mista com rastreamento posicional interior-exterior do corpo do usuário e do ambiente
BR112015024910A2 (pt) dispositivo de exibição montado na cabeça, método de controle de dispositivo de exibição montado na cabeça e sistema de exibição
BR112016013563A8 (pt) método e sistema de calibragem de sistemas de realidade virtual
NZ746640A (en) Interactions with 3d virtual objects using poses and multiple-dof controllers
BR112013031118A2 (pt) Método e sistema para gerar um modelo de mão de um usuário
WO2018142228A3 (en) Systems, methods, apparatuses and devices for detecting facial expression and for tracking movement and location including for at least one of a virtual and augmented reality system
AU2019279990A1 (en) Digital camera with audio, visual and motion analysis
BR112018069351A2 (pt) relações espaciais para integração de imagens visuais de ambiente físico em realidade virtual
BR112015010280A8 (pt) aparelho, método e sistema de exibição de imagem, aparelho móvel, e, mídia de armazenamento legível por computador
EP3594086A3 (en) Guideway mounted vehicle localization system
BR112018072791A2 (pt) arquitetura de domínio híbrido gráfico e de pixels para vídeo em 360 graus
BR0312367A (pt) sistema e método para criar uma exposição de espaço livre
BR112018006470A2 (pt) método de controle de deslocamento e aparelho de controle de deslocamento
BR112017012637A2 (pt) método para exibir características termográficas em uma difusão, e, sistema para exibir características termográficas e efeitos em uma difusão
WO2017165231A9 (en) Head mounted display system configured to exchange biometric information
BR112015015073A2 (pt) monitor de pose com base em visão de computador e de pose com base em sensor inercial separadas
BR112013013949A2 (pt) controle de exibição de conteúdo em controladores de passageiros em rede e unidades de exibição de vídeo
RU2018113697A (ru) Система проецируемой реальности в транспортном средстве и способ стабилизации изображения проецируемой реальности в транспортном средстве
BR112014019490A8 (pt) Método para gerenciamento de orientação de tela de um dispositivo eletrônico portátil e dispositivo eletrônico portátil capaz de gerir orientação de tela
BR112014026361A2 (pt) sistema e método de monitoramento de posição
BR112014007720A2 (pt) interface de quarto de paciente, sistema de controle de ambiente do quarto do paciente e método de controle de ambiente dentro de um quarto de paciente

Legal Events

Date Code Title Description
B350 Update of information on the portal [chapter 15.35 patent gazette]
B08F Application dismissed because of non-payment of annual fees [chapter 8.6 patent gazette]

Free format text: REFERENTE A 5A ANUIDADE.

B08K Patent lapsed as no evidence of payment of the annual fee has been furnished to inpi [chapter 8.11 patent gazette]

Free format text: EM VIRTUDE DO ARQUIVAMENTO PUBLICADO NA RPI 2677 DE 26-04-2022 E CONSIDERANDO AUSENCIA DE MANIFESTACAO DENTRO DOS PRAZOS LEGAIS, INFORMO QUE CABE SER MANTIDO O ARQUIVAMENTO DO PEDIDO DE PATENTE, CONFORME O DISPOSTO NO ARTIGO 12, DA RESOLUCAO 113/2013.