JP7198772B2 - マルチヘッドマウントディスプレイ仮想現実構成でのディスプレイペーシング - Google Patents

マルチヘッドマウントディスプレイ仮想現実構成でのディスプレイペーシング Download PDF

Info

Publication number
JP7198772B2
JP7198772B2 JP2019557580A JP2019557580A JP7198772B2 JP 7198772 B2 JP7198772 B2 JP 7198772B2 JP 2019557580 A JP2019557580 A JP 2019557580A JP 2019557580 A JP2019557580 A JP 2019557580A JP 7198772 B2 JP7198772 B2 JP 7198772B2
Authority
JP
Japan
Prior art keywords
displays
refresh
gpu
resources
offset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019557580A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020519929A (ja
JP2020519929A5 (enExample
Inventor
リグール グエンナディ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ATI Technologies ULC
Original Assignee
ATI Technologies ULC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ATI Technologies ULC filed Critical ATI Technologies ULC
Publication of JP2020519929A publication Critical patent/JP2020519929A/ja
Publication of JP2020519929A5 publication Critical patent/JP2020519929A5/ja
Application granted granted Critical
Publication of JP7198772B2 publication Critical patent/JP7198772B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/64—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/002—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/363—Graphics controllers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0252—Improving the response speed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/06—Use of more than one graphics processor to process data before displaying to one or more screens
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/18—Use of a frame buffer in a display terminal, inclusive of the display panel

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Optics & Photonics (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
JP2019557580A 2017-04-25 2018-04-19 マルチヘッドマウントディスプレイ仮想現実構成でのディスプレイペーシング Active JP7198772B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/496,972 US11474354B2 (en) 2017-04-25 2017-04-25 Display pacing in multi-head mounted display virtual reality configurations
US15/496,972 2017-04-25
PCT/IB2018/052735 WO2018198002A1 (en) 2017-04-25 2018-04-19 Display pacing in multi-head mounted display virtual reality configurations

Publications (3)

Publication Number Publication Date
JP2020519929A JP2020519929A (ja) 2020-07-02
JP2020519929A5 JP2020519929A5 (enExample) 2021-05-27
JP7198772B2 true JP7198772B2 (ja) 2023-01-04

Family

ID=63854418

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019557580A Active JP7198772B2 (ja) 2017-04-25 2018-04-19 マルチヘッドマウントディスプレイ仮想現実構成でのディスプレイペーシング

Country Status (6)

Country Link
US (1) US11474354B2 (enExample)
EP (1) EP3616401B1 (enExample)
JP (1) JP7198772B2 (enExample)
KR (1) KR102628899B1 (enExample)
CN (1) CN110521203B (enExample)
WO (1) WO2018198002A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3619568A4 (en) * 2017-05-01 2021-01-27 Infinity Augmented Reality Israel Ltd. OPTICAL MOTOR TIME ALIGNMENT FOR AN AUGMENTED OR MIXED REALITY ENVIRONMENT
US10521881B1 (en) * 2017-09-28 2019-12-31 Apple Inc. Error concealment for a head-mountable device
US10976982B2 (en) * 2018-02-02 2021-04-13 Samsung Electronics Co., Ltd. Guided view mode for virtual reality
US10388255B2 (en) * 2018-06-29 2019-08-20 Intel Corporation Computers for supporting multiple virtual reality display devices and related methods
US11151965B2 (en) * 2019-08-22 2021-10-19 Qualcomm Incorporated Methods and apparatus for refreshing multiple displays
US12148120B2 (en) * 2019-12-18 2024-11-19 Ati Technologies Ulc Frame reprojection for virtual reality and augmented reality
CN112230776B (zh) * 2020-10-29 2024-07-02 北京京东方光电科技有限公司 虚拟现实显示方法、装置及存储介质
CN112489226B (zh) * 2020-11-26 2024-07-26 京东方科技集团股份有限公司 虚拟现实设备图像显示方法、装置、存储介质及电子设备
US12437732B2 (en) * 2020-12-28 2025-10-07 Ati Technologies Ulc Display wall synchronization using variable refresh rate modules
CN113296723B (zh) * 2021-05-21 2022-04-01 重庆紫光华山智安科技有限公司 目标框与视频帧的同步显示方法、系统、设备及介质
US12106488B2 (en) * 2022-05-09 2024-10-01 Qualcomm Incorporated Camera frame extrapolation for video pass-through
US11978372B1 (en) 2023-05-16 2024-05-07 Qualcomm Incorporated Synchronized dual eye variable refresh rate update for VR display
CN119729126B (zh) * 2024-12-02 2025-11-04 天翼云科技有限公司 基于自适应同步技术云游戏场景画面撕裂的解决方法及装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080246771A1 (en) 2007-04-03 2008-10-09 Dell Products L.P. Graphics processing system and method
CN103593155A (zh) 2013-11-06 2014-02-19 华为终端有限公司 显示帧生成方法和终端设备
US20160093108A1 (en) 2014-09-30 2016-03-31 Sony Computer Entertainment Inc. Synchronizing Multiple Head-Mounted Displays to a Unified Space and Correlating Movement of Objects in the Unified Space
JP2016096440A (ja) 2014-11-13 2016-05-26 キヤノン株式会社 映像符号化データ送信装置、管理装置及びプログラム
JP2016162033A (ja) 2015-02-27 2016-09-05 株式会社ソニー・インタラクティブエンタテインメント 画像生成システム、画像生成方法、プログラム及び情報記憶媒体
US20170053620A1 (en) 2015-08-20 2017-02-23 Qualcomm Incorporated Refresh rate matching with predictive time-shift compensation
JP2017524275A (ja) 2014-05-30 2017-08-24 ソニー株式会社 通信装置、およびデータ処理方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0628199A (ja) * 1990-03-05 1994-02-04 Internatl Business Mach Corp <Ibm> 並行処理の同期方法
US8982151B2 (en) * 2010-06-14 2015-03-17 Microsoft Technology Licensing, Llc Independently processing planes of display data
US8797340B2 (en) * 2012-10-02 2014-08-05 Nvidia Corporation System, method, and computer program product for modifying a pixel value as a function of a display duration estimate
US20140152676A1 (en) 2012-11-30 2014-06-05 Dave Rohn Low latency image display on multi-display device
IL291010B2 (en) * 2013-11-27 2024-01-01 Magic Leap Inc Virtual and augmented reality systems and methods
JP6356509B2 (ja) 2014-07-09 2018-07-11 日本プラスト株式会社 ハンドル
WO2016041088A1 (en) * 2014-09-19 2016-03-24 Sulon Technologies Inc. System and method for tracking wearable peripherals in augmented reality and virtual reality applications
US20160180762A1 (en) 2014-12-22 2016-06-23 Elwha Llc Systems, methods, and devices for controlling screen refresh rates
US9824498B2 (en) 2014-12-30 2017-11-21 Sony Interactive Entertainment Inc. Scanning display system in head-mounted display for virtual reality
JP6684559B2 (ja) 2015-09-16 2020-04-22 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
CN105635805B (zh) * 2015-12-18 2018-12-21 潍坊歌尔电子有限公司 一种虚拟现实场景中优化运动图像的方法和装置
US9940858B2 (en) * 2016-05-16 2018-04-10 Unity IPR ApS System and method for assymetric rendering to eyes in augmented reality and virtual reality devices
US10068553B2 (en) * 2016-09-12 2018-09-04 Intel Corporation Enhanced rendering by a wearable display attached to a tethered computer

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080246771A1 (en) 2007-04-03 2008-10-09 Dell Products L.P. Graphics processing system and method
CN103593155A (zh) 2013-11-06 2014-02-19 华为终端有限公司 显示帧生成方法和终端设备
JP2017524275A (ja) 2014-05-30 2017-08-24 ソニー株式会社 通信装置、およびデータ処理方法
US20160093108A1 (en) 2014-09-30 2016-03-31 Sony Computer Entertainment Inc. Synchronizing Multiple Head-Mounted Displays to a Unified Space and Correlating Movement of Objects in the Unified Space
JP2016096440A (ja) 2014-11-13 2016-05-26 キヤノン株式会社 映像符号化データ送信装置、管理装置及びプログラム
JP2016162033A (ja) 2015-02-27 2016-09-05 株式会社ソニー・インタラクティブエンタテインメント 画像生成システム、画像生成方法、プログラム及び情報記憶媒体
US20170053620A1 (en) 2015-08-20 2017-02-23 Qualcomm Incorporated Refresh rate matching with predictive time-shift compensation

Also Published As

Publication number Publication date
WO2018198002A1 (en) 2018-11-01
JP2020519929A (ja) 2020-07-02
EP3616401A1 (en) 2020-03-04
CN110521203B (zh) 2022-03-11
KR20190141698A (ko) 2019-12-24
US20180307042A1 (en) 2018-10-25
CN110521203A (zh) 2019-11-29
US11474354B2 (en) 2022-10-18
EP3616401B1 (en) 2023-06-21
KR102628899B1 (ko) 2024-01-25
EP3616401A4 (en) 2021-01-27

Similar Documents

Publication Publication Date Title
JP7198772B2 (ja) マルチヘッドマウントディスプレイ仮想現実構成でのディスプレイペーシング
US10909654B2 (en) Management of graphics processing units in a cloud platform
CN101548277B (zh) 多并行处理器的计算机图形系统
JP4383853B2 (ja) 時間アロケータを有するグラフィックレンダリングエンジンを用いる装置、方法及びシステム
JP6467062B2 (ja) スプーフクロック及び細粒度周波数制御を使用する下位互換性
JP5638666B2 (ja) シームレスな表示移行
US11244427B2 (en) Image resolution processing method, system, and apparatus, storage medium, and device
US10997884B2 (en) Reducing video image defects by adjusting frame buffer processes
CN105027563A (zh) 多显示器设备上的低等待时间图像显示
KR102773528B1 (ko) 성능 보장 전력 관리를 갖는 실시간 gpu 렌더링
TW201419210A (zh) 圖形驅動程式層級解耦顯像以及顯示的方法
JP2020502553A (ja) デスクトップ環境においてアプリケーションのレンダリングからオンスクリーンになるまでの時間を動的に短縮する方法及び装置
KR100925302B1 (ko) 디스플레이 서브시스템용 작업 기반 클록 관리를 위한시스템 및 방법
CN112470464B (zh) 场顺序显示器中的场内子码时序
TW202121220A (zh) 借助於合成器生成一系列訊框方法和裝置
CN113892134A (zh) 具有优化的性能的多媒体系统
CN110941408A (zh) 一种kvm虚拟机图形界面输出方法及装置
JP4011082B2 (ja) 情報処理装置、グラフィックプロセッサ、制御用プロセッサおよび情報処理方法
US20150109473A1 (en) Programming a camera sensor
US20220083766A1 (en) Computer program, server, terminal device, system, and method
WO2025060779A1 (zh) 一种调频方法及电子设备
WO2024230751A1 (zh) 终端设备和图像超分方法
WO2024238104A1 (en) Efficient multi-view rendering in multi-user split xr systems
JP2024501283A (ja) ソフトウェア実施ゲンロック及びフレームロック
CN121300891A (zh) 处理方法、装置、电子设备、存储介质及计算机程序产品

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200110

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210416

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210416

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220225

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220301

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220524

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220628

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20220928

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221026

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20221122

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20221219

R150 Certificate of patent or registration of utility model

Ref document number: 7198772

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250