JP7381482B2 - ディスプレイシステムのための深度ベースの中心窩化レンダリング - Google Patents

ディスプレイシステムのための深度ベースの中心窩化レンダリング Download PDF

Info

Publication number
JP7381482B2
JP7381482B2 JP2020548949A JP2020548949A JP7381482B2 JP 7381482 B2 JP7381482 B2 JP 7381482B2 JP 2020548949 A JP2020548949 A JP 2020548949A JP 2020548949 A JP2020548949 A JP 2020548949A JP 7381482 B2 JP7381482 B2 JP 7381482B2
Authority
JP
Japan
Prior art keywords
resolution
user
virtual object
display system
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020548949A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2019178566A5 (https=
JP2021518679A5 (https=
JP2021518679A (ja
Inventor
ヴァイブハブ マトゥール，
ライオネル アーネスト エドウィン，
シャオヤン ジャン，
ビョルン ニコラース セルヴァティウス ブラスカンプ，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2021518679A publication Critical patent/JP2021518679A/ja
Publication of JPWO2019178566A5 publication Critical patent/JPWO2019178566A5/ja
Publication of JP2021518679A5 publication Critical patent/JP2021518679A5/ja
Priority to JP2023129981A priority Critical patent/JP7594060B2/ja
Application granted granted Critical
Publication of JP7381482B2 publication Critical patent/JP7381482B2/ja
Priority to JP2024195035A priority patent/JP2025013564A/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39—Control of the bit-mapped memory
    • G09G5/391—Resolution modifying circuits, e.g. variable screen formats
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0147—Head-up displays characterised by optical features comprising a device modifying the resolution of the displayed image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/36—Level of detail
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0261—Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0606—Manual adjustment
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0613—The adjustment depending on the type of the information to be displayed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0428—Gradation resolution change
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/144—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light being ambient light

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
JP2020548949A 2018-03-16 2019-03-15 ディスプレイシステムのための深度ベースの中心窩化レンダリング Active JP7381482B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2023129981A JP7594060B2 (ja) 2018-03-16 2023-08-09 ディスプレイシステムのための深度ベースの中心窩化レンダリング
JP2024195035A JP2025013564A (ja) 2018-03-16 2024-11-07 ディスプレイシステムのための深度ベースの中心窩化レンダリング

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862644366P 2018-03-16 2018-03-16
US62/644,366 2018-03-16
PCT/US2019/022619 WO2019178566A1 (en) 2018-03-16 2019-03-15 Depth based foveated rendering for display systems

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2023129981A Division JP7594060B2 (ja) 2018-03-16 2023-08-09 ディスプレイシステムのための深度ベースの中心窩化レンダリング

Publications (4)

Publication Number Publication Date
JP2021518679A JP2021518679A (ja) 2021-08-02
JPWO2019178566A5 JPWO2019178566A5 (https=) 2022-03-23
JP2021518679A5 JP2021518679A5 (https=) 2022-03-23
JP7381482B2 true JP7381482B2 (ja) 2023-11-15

Family

ID=67904123

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2020548949A Active JP7381482B2 (ja) 2018-03-16 2019-03-15 ディスプレイシステムのための深度ベースの中心窩化レンダリング
JP2023129981A Active JP7594060B2 (ja) 2018-03-16 2023-08-09 ディスプレイシステムのための深度ベースの中心窩化レンダリング
JP2024195035A Pending JP2025013564A (ja) 2018-03-16 2024-11-07 ディスプレイシステムのための深度ベースの中心窩化レンダリング

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2023129981A Active JP7594060B2 (ja) 2018-03-16 2023-08-09 ディスプレイシステムのための深度ベースの中心窩化レンダリング
JP2024195035A Pending JP2025013564A (ja) 2018-03-16 2024-11-07 ディスプレイシステムのための深度ベースの中心窩化レンダリング

Country Status (5)

Country Link
US (4) US11238836B2 (https=)
EP (2) EP4648015A3 (https=)
JP (3) JP7381482B2 (https=)
CN (1) CN112136094A (https=)
WO (1) WO2019178566A1 (https=)

Families Citing this family (97)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL312713A (en) 2016-11-18 2024-07-01 Magic Leap Inc Waveguide light multiplexer using crossed gratings
IL300511A (en) 2017-03-22 2023-04-01 Magic Leap Inc Depth-based rendering for display systems
US10922878B2 (en) * 2017-10-04 2021-02-16 Google Llc Lighting for inserted content
US10712576B1 (en) * 2017-10-24 2020-07-14 Facebook Technologies, Llc Pupil steering head-mounted display
EP4648015A3 (en) 2018-03-16 2026-01-14 Magic Leap, Inc. Depth based foveated rendering for display systems
CN115842907A (zh) * 2018-03-27 2023-03-24 京东方科技集团股份有限公司 渲染方法、计算机产品及显示装置
US11443719B2 (en) * 2018-03-29 2022-09-13 Sony Corporation Information processing apparatus and information processing method
US11435577B2 (en) * 2018-04-25 2022-09-06 Dhanushan Balachandreswaran Foveated projection system to produce ocular resolution near-eye displays
DE102018110644B4 (de) * 2018-05-03 2024-02-15 Carl Zeiss Meditec Ag Digitales Mikroskop und digitales Mikroskopieverfahren
US11250819B2 (en) * 2018-05-24 2022-02-15 Lockheed Martin Corporation Foveated imaging system
US10475248B1 (en) * 2018-06-08 2019-11-12 Microsoft Technology Licensing, Llc Real-time compositing in mixed reality
CN109194953B (zh) * 2018-08-15 2021-03-02 瑞声光学解决方案私人有限公司 空间颜色和分辨率测量装置及测量方法
KR102750454B1 (ko) * 2018-08-21 2025-01-07 삼성전자주식회사 웨어러블 장치 및 그 제어 방법
JP7400721B2 (ja) * 2018-08-29 2023-12-19 ソニーグループ株式会社 情報処理装置、情報処理方法及びプログラム
US20200125169A1 (en) * 2018-10-18 2020-04-23 Eyetech Digital Systems, Inc. Systems and Methods for Correcting Lens Distortion in Head Mounted Displays
CN109188700B (zh) * 2018-10-30 2021-05-11 京东方科技集团股份有限公司 光学显示系统及ar/vr显示装置
US10852619B1 (en) * 2018-11-01 2020-12-01 Facebook Technologies, Llc Multifocal system using adaptive lenses
WO2020122128A1 (ja) * 2018-12-11 2020-06-18 富士フイルム株式会社 導光素子、画像表示装置およびセンシング装置
EP3987343A4 (en) 2019-06-20 2023-07-19 Magic Leap, Inc. EYEWEARS FOR AUGMENTED REALITY DISPLAY SYSTEM
US11009766B2 (en) * 2019-06-28 2021-05-18 Intel Corporation Foveated virtual reality near eye displays
US10788893B1 (en) 2019-08-06 2020-09-29 Eyetech Digital Systems, Inc. Computer tablet augmented with internally integrated eye-tracking camera assembly
US20220146822A1 (en) * 2019-08-15 2022-05-12 Ostendo Technologies, Inc. Wearable Display Systems and Design Methods Thereof
KR20220093041A (ko) 2019-11-06 2022-07-05 에이치이에스 아이피 홀딩스, 엘엘씨 깊이를 갖는 오브젝트를 디스플레이하기 위한 시스템 및 방법
CN111178191B (zh) * 2019-11-11 2022-01-11 贝壳找房(北京)科技有限公司 信息播放方法、装置、计算机可读存储介质及电子设备
CN114746903B (zh) * 2019-12-06 2023-11-14 奇跃公司 虚拟、增强和混合现实系统和方法
US11269181B2 (en) * 2019-12-09 2022-03-08 Magic Leap, Inc. Systems and methods for operating a head-mounted display system based on user identity
US11860455B2 (en) * 2019-12-11 2024-01-02 Nvidia Corporation Modular prescription augmented reality display
US11544903B2 (en) * 2019-12-13 2023-01-03 Sony Group Corporation Reducing volumetric data while retaining visual fidelity
US11668932B2 (en) * 2020-01-06 2023-06-06 Meta Platforms Technologies, Llc Switchable Pancharatnam-Berry phase grating stack
US11538199B2 (en) * 2020-02-07 2022-12-27 Lenovo (Singapore) Pte. Ltd. Displaying a window in an augmented reality view
WO2021182126A1 (ja) * 2020-03-09 2021-09-16 ソニーグループ株式会社 情報処理装置、情報処理方法、および記録媒体
US11222394B2 (en) * 2020-03-19 2022-01-11 Arm Limited Devices and headsets
US11153556B1 (en) * 2020-03-31 2021-10-19 Toyota Motor Engineering & Manufacturing North America, Inc. Volumetric accessing of a volumetric display
CN115769174A (zh) * 2020-04-03 2023-03-07 奇跃公司 用于最佳注视辨别的化身定制
CN111553972B (zh) * 2020-04-27 2023-06-30 北京百度网讯科技有限公司 用于渲染增强现实数据的方法、装置、设备及存储介质
FR3110710A1 (fr) * 2020-05-19 2021-11-26 Thales Dispositif électronique de gestion d’affichage d’un écran d’affichage tête haute, système d’affichage, procédé de gestion et produit programme ordinateur associés
EP4154512B1 (en) * 2020-05-21 2025-04-30 Magic Leap, Inc. Warping for laser beam scanning displays using eye tracking
CN115668101A (zh) 2020-05-21 2023-01-31 奇跃公司 使用眼睛跟踪对空间光调制显示器进行扭曲
WO2021237168A1 (en) * 2020-05-22 2021-11-25 Magic Leap, Inc. Method and system for dual projector waveguide displays with wide field of view
EP4189527A1 (en) * 2020-08-03 2023-06-07 Apple Inc. Adjusting image content to improve user experience
EP4214554A4 (en) 2020-09-16 2024-10-09 Magic Leap, Inc. EYEPIECES FOR AN AUGMENTED REALITY DISPLAY SYSTEM
WO2022066341A1 (en) * 2020-09-22 2022-03-31 Sterling Labs Llc Attention-driven rendering for computer-generated objects
CN116420104A (zh) 2020-09-30 2023-07-11 海思智财控股有限公司 用于虚拟实境及扩增实境装置的虚拟影像显示系统
US11164375B1 (en) * 2020-10-21 2021-11-02 Tanzle, Inc. Stereoscopic rendering of non-flat, reflective or refractive surfaces
US20230408830A1 (en) * 2020-10-30 2023-12-21 Hewlett-Packard Development Company, L.P. Head mounted display assembly
GB2600763B (en) * 2020-11-10 2023-05-24 Sony Interactive Entertainment Inc Image rendering system and method
WO2022104229A1 (en) * 2020-11-13 2022-05-19 Raxium, Inc. Eyebox expanding viewing optics assembly for stereo-viewing
US11151774B1 (en) * 2020-11-20 2021-10-19 At&T Intellectual Property I, L.P. Adaptive immersive media rendering pipeline
JP2022086237A (ja) * 2020-11-30 2022-06-09 セイコーエプソン株式会社 虚像表示装置
US11809622B2 (en) * 2020-12-21 2023-11-07 Samsung Electronics Co., Ltd. Electronic device and method for eye-tracking of user and providing augmented reality service thereof
CN116261685A (zh) * 2020-12-30 2023-06-13 谷歌有限责任公司 扫描投影仪动态分辨率
JPWO2022149189A1 (https=) * 2021-01-05 2022-07-14
US20240151964A1 (en) * 2021-01-11 2024-05-09 Magic Leap, Inc. Actuated pupil steering for head-mounted display systems
US20240423465A1 (en) * 2021-01-25 2024-12-26 Quantum Radius Corporation Retinal foveation system and method
CN115280219B (zh) * 2021-02-08 2026-01-06 英属开曼群岛商沃弥股份有限公司 强化视力的系统与方法
WO2022174405A1 (en) * 2021-02-20 2022-08-25 University Of Central Florida Research Foundation, Inc. Optical display system and electronics device
CN117043663A (zh) * 2021-03-31 2023-11-10 索尼集团公司 图像显示设备
CN115309256B (zh) * 2021-05-07 2026-03-27 华为技术有限公司 一种显示方法与电子设备
GB202107231D0 (en) * 2021-05-20 2021-07-07 Ams Int Ag Eye tracking
US12562141B2 (en) 2021-06-03 2026-02-24 Sony Semiconductor Solutions Corporation Display device, display system, and display driving method
DE102021205700B4 (de) * 2021-06-07 2023-07-06 Siemens Healthcare Gmbh Darstellungsvorrichtung zur Anzeige einer erweiterten Realität und Verfahren zum Bereitstellen einer erweiterten Realität
WO2022271494A1 (en) * 2021-06-22 2022-12-29 Arizona Board Of Regents On Behalf Of The University Of Arizona Diffractive optics having transversely distributed multiple foci
US12416970B2 (en) * 2021-08-05 2025-09-16 Semiconductor Energy Laboratory Co., Ltd. Electronic device and operation method of the electronic device
DE102022206804A1 (de) * 2021-08-16 2023-02-16 Apple Inc. Generieren und anzeigen von inhalt basierend auf jeweiligen positionen von personen
WO2023049086A2 (en) * 2021-09-22 2023-03-30 Veyezer, Llc Holographic real space refractive system
WO2023114450A1 (en) * 2021-12-16 2023-06-22 Google Llc Tricolor waveguide exit pupil expansion system with optical power
US12228735B2 (en) 2021-12-16 2025-02-18 Google Llc Tricolor waveguide exit pupil expansion system with optical power
JP7809814B2 (ja) * 2021-12-20 2026-02-02 マジック リープ， インコーポレイテッド 拡張現実デバイスにおいて光学結像を実施するための方法およびシステム
JP7097125B1 (ja) * 2021-12-22 2022-07-07 株式会社セルシス 映像生成方法及び画像生成プログラム
CN114669047B (zh) * 2022-02-28 2023-06-02 荣耀终端有限公司 一种图像处理方法、电子设备及存储介质
JP2023148488A (ja) * 2022-03-30 2023-10-13 日本電気株式会社 情報処理装置、情報処理方法及びプログラム
GB2618354B (en) 2022-05-05 2024-12-18 Envisics Ltd Head-up display
JP7770253B2 (ja) * 2022-05-30 2025-11-14 本田技研工業株式会社 視線推定装置、視線推定方法、およびプログラム
KR102863140B1 (ko) * 2022-06-02 2025-09-24 한국전자기술연구원 대상 객체 적응적 심도 가변형 증강현실 장치 및 방법
CN115185083B (zh) * 2022-07-14 2024-02-06 东南大学 一种ar头戴显示器自适应刷新率和分辨率渲染方法
CN115327773B (zh) * 2022-07-19 2024-02-06 深圳市光途显示科技有限公司 显示设备、应用显示设备的车辆及显示虚拟图像的方法
CN115514859B (zh) * 2022-09-09 2025-12-16 维沃移动通信有限公司 图像处理电路、图像处理方法及电子设备
WO2024064089A1 (en) * 2022-09-20 2024-03-28 Apple Inc. Image generation with resolution constraints
US12361517B2 (en) * 2022-10-19 2025-07-15 Qualcomm Incorporated View-dependent multiple streaming for extended reality (XR) rendering offloading
US11935442B1 (en) * 2022-10-31 2024-03-19 Snap Inc. Controlling brightness based on eye tracking
JPWO2024147249A1 (https=) * 2023-01-05 2024-07-11
US12566496B1 (en) * 2023-03-30 2026-03-03 Apple Inc. Refoveation of rendered content based on gaze
US12603023B2 (en) 2023-04-28 2026-04-14 Meta Platforms Technologies, Llc Light modulation for foveated display
US12481358B1 (en) 2023-05-02 2025-11-25 Snap Inc. Foveated sensing for extended reality
US12425743B2 (en) * 2023-05-12 2025-09-23 Google Llc Foveated images with adaptive exposure
EP4693008A1 (en) * 2023-07-25 2026-02-11 Samsung Electronics Co., Ltd. Head-mounted device for displaying screen corresponding to content, and operation method thereof
EP4722868A1 (en) * 2023-08-21 2026-04-08 Samsung Electronics Co., Ltd. Wearable device, method, and computer-readable storage medium for identifying gaze of user
WO2025087527A1 (en) * 2023-10-26 2025-05-01 Telefonaktiebolaget Lm Ericsson (Publ) Multi-field-of-view video with higher angularly-compressed peripheral areas relative to a user gaze area for rendering an extended reality environment
WO2025105113A1 (ja) * 2023-11-14 2025-05-22 パナソニックＩｐマネジメント株式会社 画像生成装置およびヘッドマウントディスプレイ
US20250164310A1 (en) * 2023-11-19 2025-05-22 Pixieray Oy Outdoor time tracking via eyeglasses
US12506856B2 (en) * 2023-11-20 2025-12-23 Microsoft Technology Licensing, Llc Changing FOV and resolution for calibrating scanning display system alignment
US20250166315A1 (en) * 2023-11-21 2025-05-22 Microsoft Technology Licensing, Llc Mixed-reality device having improved dark adaptation
GB2636085A (en) * 2023-11-28 2025-06-11 Sony Interactive Entertainment Inc Mesh based graphics method and system
US20250390168A1 (en) * 2024-06-24 2025-12-25 Qualcomm Incorporated In-application eye-tracking calibration
CN118840258B (zh) * 2024-09-24 2025-01-24 南京维赛客网络科技有限公司 调整虚拟场景中图片像素重叠的方法、系统及存储介质
CN120180115B (zh) * 2025-01-15 2025-11-18 数据空间研究院 联邦学习模型训练方法、高速偷逃费行为识别方法
CN120111202B (zh) * 2025-05-07 2025-07-11 华东交通大学 裸眼3d图像生成方法、系统、电子设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030194142A1 (en) 2002-04-15 2003-10-16 Kortum Philip T. Multi-resolution predictive foveation for bandwidth reduction of moving images
JP2010153983A (ja) 2008-12-24 2010-07-08 Panasonic Electric Works Co Ltd 投影型映像表示装置および該方法
JP2017107134A (ja) 2015-12-11 2017-06-15 株式会社ニコン 表示装置、電子機器、画像処理装置および画像処理プログラム
US20170287446A1 (en) 2016-03-31 2017-10-05 Sony Computer Entertainment Inc. Real-time user adaptive foveated rendering
JP2017229037A (ja) 2016-06-24 2017-12-28 日本電信電話株式会社 表示装置
WO2018022523A1 (en) 2016-07-25 2018-02-01 Magic Leap, Inc. Imaging modification, display and visualization using augmented and virtual reality eyewear

Family Cites Families (85)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
JPH08234141A (ja) 1994-12-01 1996-09-13 Olympus Optical Co Ltd 頭部装着型映像表示装置
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
JP2002542505A (ja) 1999-04-08 2002-12-10 ニューヨーク ユニバーシティ 超解像力を有する中心窩画像表示装置
US9781408B1 (en) * 2001-01-23 2017-10-03 Visual Effect Innovations, Llc Faster state transitioning for continuous adjustable 3Deeps filter spectacles using multi-layered variable tint materials
US10742965B2 (en) * 2001-01-23 2020-08-11 Visual Effect Innovations, Llc Faster state transitioning for continuous adjustable 3Deeps filter spectacles using multi-layered variable tint materials
US20030067476A1 (en) 2001-10-04 2003-04-10 Eastman Kodak Company Method and system for displaying an image
US7872635B2 (en) 2003-05-15 2011-01-18 Optimetrics, Inc. Foveated display eye-tracking system and method
JP4923383B2 (ja) * 2004-03-18 2012-04-25 セイコーエプソン株式会社 光学表示装置、光学表示装置制御プログラム
US20050232530A1 (en) 2004-04-01 2005-10-20 Jason Kekas Electronically controlled volume phase grating devices, systems and fabrication methods
USD514570S1 (en) 2004-06-24 2006-02-07 Microsoft Corporation Region of a fingerprint scanning device with an illuminated ring
US7173619B2 (en) * 2004-07-08 2007-02-06 Microsoft Corporation Matching digital information flow to a human perception system
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US7850306B2 (en) * 2008-08-28 2010-12-14 Nokia Corporation Visual cognition aware display and visual data transmission architecture
US11320571B2 (en) 2012-11-16 2022-05-03 Rockwell Collins, Inc. Transparent waveguide display providing upper and lower fields of view with uniform light extraction
US9304319B2 (en) * 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
AU2011348122A1 (en) 2010-12-24 2013-07-11 Magic Leap Inc. An ergonomic head mounted display device and optical system
JP6316186B2 (ja) 2011-05-06 2018-04-25 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 広範囲同時遠隔ディジタル提示世界
WO2013036236A1 (en) 2011-09-08 2013-03-14 Intel Corporation Interactive screen viewing
EP2760363A4 (en) 2011-09-29 2015-06-24 Magic Leap Inc TACTILE GLOVE FOR HUMAN COMPUTER INTERACTION
US9215293B2 (en) 2011-10-28 2015-12-15 Magic Leap, Inc. System and method for augmented and virtual reality
US8950867B2 (en) 2011-11-23 2015-02-10 Magic Leap, Inc. Three dimensional virtual and augmented reality display system
WO2013152205A1 (en) 2012-04-05 2013-10-10 Augmented Vision Inc. Wide-field of view (fov) imaging devices with active foveation capability
US20130300635A1 (en) * 2012-05-09 2013-11-14 Nokia Corporation Method and apparatus for providing focus correction of displayed information
WO2013188464A1 (en) 2012-06-11 2013-12-19 Magic Leap, Inc. Multiple depth plane three-dimensional display using a wave guide reflector array projector
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
KR20150054967A (ko) 2012-09-11 2015-05-20 매직 립, 인코포레이티드 인체공학적 헤드 마운티드 디스플레이 디바이스 및 광학 시스템
US20140092006A1 (en) 2012-09-28 2014-04-03 Joshua Boelter Device and method for modifying rendering based on viewer focus area from eye tracking
US10514541B2 (en) * 2012-12-27 2019-12-24 Microsoft Technology Licensing, Llc Display update time reduction for a near-eye display
KR102141992B1 (ko) 2013-01-15 2020-08-06 매직 립, 인코포레이티드 초고해상도 스캐닝 섬유 디스플레이
IL308285B2 (en) 2013-03-11 2024-11-01 Magic Leap Inc System and method for augmentation and virtual reality
US9417452B2 (en) 2013-03-15 2016-08-16 Magic Leap, Inc. Display system and method
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
JP6479785B2 (ja) 2013-10-16 2019-03-06 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 調節可能な瞳孔間距離を有する仮想または拡張現実ヘッドセット
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
US11402629B2 (en) 2013-11-27 2022-08-02 Magic Leap, Inc. Separated pupil optical systems for virtual and augmented reality and methods for displaying images using same
CN107272199B (zh) 2013-11-27 2023-04-07 奇跃公司 虚拟和增强现实系统与方法
CN106233189B (zh) 2014-01-31 2020-06-26 奇跃公司 多焦点显示系统和方法
KR102177133B1 (ko) 2014-01-31 2020-11-10 매직 립, 인코포레이티드 멀티-포컬 디스플레이 시스템 및 방법
US10203762B2 (en) * 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
EP3140780B1 (en) 2014-05-09 2020-11-04 Google LLC Systems and methods for discerning eye signals and continuous biometric identification
USD759657S1 (en) 2014-05-19 2016-06-21 Microsoft Corporation Connector with illumination region
NZ727350A (en) 2014-05-30 2020-08-28 Magic Leap Inc Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
CN112987307B (zh) 2014-05-30 2022-06-28 奇跃公司 用于在虚拟和增强现实中产生焦平面的方法和系统
USD752529S1 (en) 2014-06-09 2016-03-29 Comcast Cable Communications, Llc Electronic housing with illuminated region
JP6726110B2 (ja) 2014-07-31 2020-07-22 イマジンオプティクス・コーポレイション 光学素子、及び回折光学素子
WO2016021034A1 (ja) 2014-08-07 2016-02-11 株式会社Ｆｏｖｅ ３次元上の注視点の位置特定アルゴリズム
US9552062B2 (en) 2014-09-05 2017-01-24 Echostar Uk Holdings Limited Gaze-based security
US9804669B2 (en) * 2014-11-07 2017-10-31 Eye Labs, Inc. High resolution perception of content in a wide field of view of a head-mounted display
US10176639B2 (en) 2014-11-27 2019-01-08 Magic Leap, Inc. Virtual/augmented reality system having dynamic region resolution
NZ773818A (en) 2015-03-16 2022-07-29 Magic Leap Inc Methods and systems for diagnosing and treating health ailments
USD758367S1 (en) 2015-05-14 2016-06-07 Magic Leap, Inc. Virtual reality headset
US10037620B2 (en) * 2015-05-29 2018-07-31 Nvidia Corporation Piecewise linear irregular rasterization
US10043281B2 (en) * 2015-06-14 2018-08-07 Sony Interactive Entertainment Inc. Apparatus and method for estimating eye gaze location
US10210844B2 (en) * 2015-06-29 2019-02-19 Microsoft Technology Licensing, Llc Holographic near-eye display
US10176642B2 (en) * 2015-07-17 2019-01-08 Bao Tran Systems and methods for computer assisted operation
CN107852521B (zh) * 2015-08-07 2023-04-11 苹果公司 用于显示图像流的系统和方法
CN114998557A (zh) 2015-08-18 2022-09-02 奇跃公司 虚拟和增强现实系统和方法
EP3353750B1 (en) 2015-09-25 2021-09-01 Magic Leap, Inc. Methods and systems for detecting and combining structural features in 3d reconstruction
KR102701209B1 (ko) 2015-10-20 2024-08-29 매직 립, 인코포레이티드 3차원 공간에서 가상 객체들 선택
US11010956B2 (en) * 2015-12-09 2021-05-18 Imagination Technologies Limited Foveated rendering
US10311540B2 (en) * 2016-02-03 2019-06-04 Valve Corporation Radial density masking systems and methods
USD805734S1 (en) 2016-03-04 2017-12-26 Nike, Inc. Shirt
USD794288S1 (en) 2016-03-11 2017-08-15 Nike, Inc. Shoe with illuminable sole light sequence
JP6632443B2 (ja) 2016-03-23 2020-01-22 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理システム、および情報処理方法
WO2017168038A1 (en) * 2016-03-31 2017-10-05 Umbra Software Oy Virtual reality streaming
US9721393B1 (en) * 2016-04-29 2017-08-01 Immersive Enterprises, LLC Method for processing and delivering virtual reality content to a user
US20170373459A1 (en) 2016-06-27 2017-12-28 University Of Central Florida Research Foundation, Inc. Volume polarization grating, methods of making, and applications
US10373592B2 (en) 2016-08-01 2019-08-06 Facebook Technologies, Llc Adaptive parameters in image regions based on eye tracking information
WO2018039277A1 (en) * 2016-08-22 2018-03-01 Magic Leap, Inc. Diffractive eyepiece
US11551602B2 (en) * 2016-09-01 2023-01-10 Innovega Inc. Non-uniform resolution, large field-of-view headworn display
WO2018057660A2 (en) * 2016-09-20 2018-03-29 Apple Inc. Augmented reality system
WO2018089329A1 (en) 2016-11-10 2018-05-17 Magic Leap, Inc. Method and system for eye tracking using speckle patterns
US10948722B2 (en) 2016-11-16 2021-03-16 Magic Leap, Inc. Multi-resolution display assembly for head-mounted display systems
IL300511A (en) 2017-03-22 2023-04-01 Magic Leap Inc Depth-based rendering for display systems
KR102578929B1 (ko) * 2017-03-27 2023-09-15 아브간트 코포레이션 조향 가능한 중심와 디스플레이
US20180292896A1 (en) * 2017-04-06 2018-10-11 Intel Corporation Head-mounted display device
US10255949B2 (en) * 2017-05-31 2019-04-09 Verizon Patent And Licensing Inc. Methods and systems for customizing virtual reality data
US10861142B2 (en) * 2017-07-21 2020-12-08 Apple Inc. Gaze direction-based adaptive pre-filtering of video data
EP4648015A3 (en) 2018-03-16 2026-01-14 Magic Leap, Inc. Depth based foveated rendering for display systems
WO2020033875A1 (en) 2018-08-10 2020-02-13 Compound Photonics Limited Apparatus, systems, and methods for foveated display

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030194142A1 (en) 2002-04-15 2003-10-16 Kortum Philip T. Multi-resolution predictive foveation for bandwidth reduction of moving images
JP2010153983A (ja) 2008-12-24 2010-07-08 Panasonic Electric Works Co Ltd 投影型映像表示装置および該方法
JP2017107134A (ja) 2015-12-11 2017-06-15 株式会社ニコン 表示装置、電子機器、画像処理装置および画像処理プログラム
US20170287446A1 (en) 2016-03-31 2017-10-05 Sony Computer Entertainment Inc. Real-time user adaptive foveated rendering
JP2017229037A (ja) 2016-06-24 2017-12-28 日本電信電話株式会社 表示装置
WO2018022523A1 (en) 2016-07-25 2018-02-01 Magic Leap, Inc. Imaging modification, display and visualization using augmented and virtual reality eyewear

Also Published As

Publication number Publication date
EP4648015A2 (en) 2025-11-12
JP7594060B2 (ja) 2024-12-03
JP2023138738A (ja) 2023-10-02
US11238836B2 (en) 2022-02-01
JP2025013564A (ja) 2025-01-24
US20250095609A1 (en) 2025-03-20
EP4648015A3 (en) 2026-01-14
WO2019178566A1 (en) 2019-09-19
EP3765943B1 (en) 2025-11-05
US11710469B2 (en) 2023-07-25
EP3765943A4 (en) 2021-12-22
EP3765943A1 (en) 2021-01-20
US20190287495A1 (en) 2019-09-19
JP2021518679A (ja) 2021-08-02
US20230317033A1 (en) 2023-10-05
CN112136094A (zh) 2020-12-25
US20220148538A1 (en) 2022-05-12
US12183310B2 (en) 2024-12-31

Similar Documents

Publication Publication Date Title
JP7594060B2 (ja) ディスプレイシステムのための深度ベースの中心窩化レンダリング
JP7667824B2 (ja) ディスプレイシステムのための深度ベース中心窩化レンダリング
KR20170015375A (ko) 가상 및 증강 현실의 초점 평면들을 생성하기 위한 방법들 및 시스템
KR20230144666A (ko) 깊이 평면들 간의 감소된 스위칭을 갖는 다중-깊이 평면 디스플레이 시스템

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220314

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220314

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230525

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230809

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20231101

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20231102

R150 Certificate of patent or registration of utility model

Ref document number: 7381482

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150