JP2024531196A - 中心窩レンダリング画像の知覚的品質を改善する方法 - Google Patents

中心窩レンダリング画像の知覚的品質を改善する方法 Download PDF

Info

Publication number
JP2024531196A
JP2024531196A JP2024508432A JP2024508432A JP2024531196A JP 2024531196 A JP2024531196 A JP 2024531196A JP 2024508432 A JP2024508432 A JP 2024508432A JP 2024508432 A JP2024508432 A JP 2024508432A JP 2024531196 A JP2024531196 A JP 2024531196A
Authority
JP
Japan
Prior art keywords
zone
foveal
image
rendered
pixel resolution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2024508432A
Other languages
English (en)
Japanese (ja)
Other versions
JP2024531196A5 (https=
Inventor
ビン ウー，
ビョルン ニコラース セルヴァティウス ブラスカンプ，
ハワード ラッセル コーエン，
ホセ フェリックス ロドリゲス，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2024531196A publication Critical patent/JP2024531196A/ja
Publication of JP2024531196A5 publication Critical patent/JP2024531196A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39—Control of the bit-mapped memory
    • G09G5/391—Resolution modifying circuits, e.g. variable screen formats
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
    • A61B3/024—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for determining the visual field, e.g. perimeter types
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0147—Head-up displays characterised by optical features comprising a device modifying the resolution of the displayed image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0686—Adjustment of display parameters with two or more screen areas displaying information with different brightness or colours
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/378—Image reproducers using viewer tracking for tracking rotational head movements around an axis perpendicular to the screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Processing (AREA)
  • Controls And Circuits For Display Device (AREA)
JP2024508432A 2021-08-13 2022-08-12 中心窩レンダリング画像の知覚的品質を改善する方法 Pending JP2024531196A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202163232787P 2021-08-13 2021-08-13
US63/232,787 2021-08-13
PCT/US2022/040267 WO2023018997A1 (en) 2021-08-13 2022-08-12 Methods to improve the perceptual quality of foveated rendered images

Publications (2)

Publication Number Publication Date
JP2024531196A true JP2024531196A (ja) 2024-08-29
JP2024531196A5 JP2024531196A5 (https=) 2025-08-26

Family

ID=85200358

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2024508432A Pending JP2024531196A (ja) 2021-08-13 2022-08-12 中心窩レンダリング画像の知覚的品質を改善する方法

Country Status (5)

Country Link
US (2) US12347062B2 (https=)
EP (1) EP4385202A4 (https=)
JP (1) JP2024531196A (https=)
CN (1) CN117859320A (https=)
WO (1) WO2023018997A1 (https=)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240095879A1 (en) * 2022-09-20 2024-03-21 Apple Inc. Image Generation with Resolution Constraints
EP4684304A1 (en) * 2023-03-20 2026-01-28 Magic Leap, Inc. Method and system for dynamic depth-based reprojection
US12501181B2 (en) * 2023-07-24 2025-12-16 Varjo Technologies Oy Complementing subsampling in stereo cameras
US20250291413A1 (en) * 2024-03-12 2025-09-18 Apple Inc. Distributed foveated rendering
CN119420894A (zh) * 2024-06-19 2025-02-11 甬江实验室 显示方法、显示装置、头戴显示器及存储介质

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10317670B2 (en) * 2017-03-03 2019-06-11 Microsoft Technology Licensing, Llc MEMS scanning display device
JP6909286B2 (ja) * 2017-05-18 2021-07-28 株式会社ソニー・インタラクティブエンタテインメント 画像生成装置、画像表示システム、および画像生成方法
EP3724846A1 (en) 2017-12-19 2020-10-21 Nokia Technologies Oy Gaze dependent foveated rendering apparatus, method, computer program and system
US10949947B2 (en) * 2017-12-29 2021-03-16 Intel Corporation Foveated image rendering for head-mounted display devices
US11064387B1 (en) * 2018-05-23 2021-07-13 Apple Inc. Adaptive wireless transmission schemes
GB2567553B (en) * 2018-09-06 2021-04-07 Sony Interactive Entertainment Inc Foveated rendering system and method
US20200341273A1 (en) * 2019-04-29 2020-10-29 Tecgyver Innovations Oy Method, System and Apparatus for Augmented Reality

Also Published As

Publication number Publication date
WO2023018997A1 (en) 2023-02-16
CN117859320A (zh) 2024-04-09
EP4385202A4 (en) 2025-06-11
US20240185380A1 (en) 2024-06-06
US20250285213A1 (en) 2025-09-11
US12347062B2 (en) 2025-07-01
EP4385202A1 (en) 2024-06-19

Similar Documents

Publication Publication Date Title
US12347062B2 (en) Methods to improve the perceptual quality of foveated rendered images
US11024267B2 (en) Display system
US10564715B2 (en) Dual-path foveated graphics pipeline
JP6644371B2 (ja) 映像表示装置
CN103581640B (zh) 图像数据处理方法以及使用其的立体图像显示器
US10262387B2 (en) Early sub-pixel rendering
US8982151B2 (en) Independently processing planes of display data
US20080151040A1 (en) Three-dimensional image display apparatus and method and system for processing three-dimensional image signal
US20100033555A1 (en) Image display apparatus and method
GB2556990A (en) Low resolution RGB rendering for efficient transmission
US20120069147A1 (en) Display device and display method
JP5472122B2 (ja) 画像伝送システムおよび画像伝送方法
JP2008072699A (ja) ステレオコンテンツの表示の際にクロストークを補償するためのシステム、方法、及びコンピュータプログラム製品
JP2011090079A (ja) 表示装置、表示方法およびコンピュータプログラム
US20200029057A1 (en) Systems and methods for correcting color separation in field-sequential displays
JP2024531196A5 (https=)
JP2008268968A (ja) 表示装置および方法
WO2022166712A1 (zh) 图像的显示方法、装置、可读介质和电子设备
US20120120191A1 (en) Image processor for use in a frame sequential 3d display system and related 3d display system
JP2022091477A (ja) 画像投射装置、画像投射装置の制御方法、及びプログラム
WO2019166795A1 (en) Temporal resolution multiplexing display systems
McVeigh et al. Double-buffering technique for binocular imaging in a window
JP2012084955A (ja) 画像表示装置
US20110090214A1 (en) Image signal processing device, image signal processing method, image display device, image display method, program, image display system and video signal

Legal Events

Date Code Title Description
RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20240613

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20240627

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250811

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20250811