CN108885339B - 用于使用自适应焦平面渲染虚拟现实的配置 - Google Patents

用于使用自适应焦平面渲染虚拟现实的配置 Download PDF

Info

Publication number
CN108885339B
CN108885339B CN201680077396.7A CN201680077396A CN108885339B CN 108885339 B CN108885339 B CN 108885339B CN 201680077396 A CN201680077396 A CN 201680077396A CN 108885339 B CN108885339 B CN 108885339B
Authority
CN
China
Prior art keywords
virtual reality
processor
pixels
field
focal plane
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201680077396.7A
Other languages
English (en)
Chinese (zh)
Other versions
CN108885339A (zh
Inventor
皮特·洛佩兹
约书亚·派恩斯
基兰·瓦拉纳西
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of CN108885339A publication Critical patent/CN108885339A/zh
Application granted granted Critical
Publication of CN108885339B publication Critical patent/CN108885339B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)
CN201680077396.7A 2015-12-31 2016-12-22 用于使用自适应焦平面渲染虚拟现实的配置 Active CN108885339B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562273833P 2015-12-31 2015-12-31
US62/273,833 2015-12-31
PCT/EP2016/082428 WO2017114755A1 (en) 2015-12-31 2016-12-22 Configuration for rendering virtual reality with an adaptive focal plane

Publications (2)

Publication Number Publication Date
CN108885339A CN108885339A (zh) 2018-11-23
CN108885339B true CN108885339B (zh) 2021-09-28

Family

ID=57681595

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680077396.7A Active CN108885339B (zh) 2015-12-31 2016-12-22 用于使用自适应焦平面渲染虚拟现实的配置

Country Status (6)

Country Link
US (1) US10713760B2 (enExample)
EP (1) EP3398004B1 (enExample)
JP (1) JP2019510991A (enExample)
KR (1) KR20180099703A (enExample)
CN (1) CN108885339B (enExample)
WO (1) WO2017114755A1 (enExample)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9699433B2 (en) * 2013-01-24 2017-07-04 Yuchen Zhou Method and apparatus to produce re-focusable vision with detecting re-focusing event from human eye
WO2019086635A1 (en) * 2017-11-03 2019-05-09 United Screens Gmbh Display system, mobile device and method for providing three-dimensional views
CN107958478B (zh) * 2017-12-15 2022-05-03 歌尔光学科技有限公司 虚拟现实场景中物体的渲染方法和虚拟现实头戴设备
CN108134928A (zh) * 2017-12-26 2018-06-08 深圳Tcl新技术有限公司 Vr显示方法和装置
EP3769513A1 (en) * 2018-03-22 2021-01-27 Huawei Technologies Co., Ltd. Immersive media metrics for field of view
CN113238651B (zh) * 2018-07-02 2025-02-14 苹果公司 用于显示系统的基于聚焦的调试和检查
CN120856880A (zh) * 2019-03-29 2025-10-28 托比股份公司 利用眼睛的瞳孔增强调节来渲染图像的方法和系统
EP3911992A4 (en) * 2019-04-11 2022-03-23 Samsung Electronics Co., Ltd. HEAD MOUNTED DISPLAY DEVICE AND METHOD OF OPERATION THEREOF
CN110084879B (zh) * 2019-04-28 2023-06-27 网易（杭州）网络有限公司 虚拟场景中的对象处理方法、装置、介质及电子设备
CN110458926B (zh) * 2019-08-01 2020-11-20 北京灵医灵科技有限公司 一种断层图像的三维虚拟化处理方法和系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102457755A (zh) * 2010-11-05 2012-05-16 乐金显示有限公司 图像显示设备及其驱动方法
WO2013191120A1 (ja) * 2012-06-19 2013-12-27 シャープ株式会社 画像処理装置、方法、プログラム、および記録媒体
CN104766590A (zh) * 2014-01-02 2015-07-08 广达电脑股份有限公司 头戴式显示装置及其背光调整方法
CN105244008A (zh) * 2015-11-09 2016-01-13 深圳市华星光电技术有限公司 一种显示设备及其亮度调节方法

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0863431B1 (en) * 1992-06-02 2004-10-20 Canon Kabushiki Kaisha Optical apparatus for detecting rotation of an eyeball of an observer
JP2000354257A (ja) * 1999-06-10 2000-12-19 Sony Corp 画像処理装置、画像処理方法、およびプログラム提供媒体
US7081892B2 (en) * 2002-04-09 2006-07-25 Sony Computer Entertainment America Inc. Image with depth of field using z-buffer image data and alpha blending
JP2006195084A (ja) * 2005-01-12 2006-07-27 Sharp Corp 表示装置
US20110228051A1 (en) * 2010-03-17 2011-09-22 Goksel Dedeoglu Stereoscopic Viewing Comfort Through Gaze Estimation
JP5529660B2 (ja) * 2010-07-20 2014-06-25 パナソニック株式会社 瞳孔検出装置及び瞳孔検出方法
US8625200B2 (en) * 2010-10-21 2014-01-07 Lockheed Martin Corporation Head-mounted display apparatus employing one or more reflective optical surfaces
US9323325B2 (en) * 2011-08-30 2016-04-26 Microsoft Technology Licensing, Llc Enhancing an object of interest in a see-through, mixed reality display device
JP2015504616A (ja) * 2011-09-26 2015-02-12 マイクロソフト コーポレーション 透過近眼式ディスプレイのセンサ入力に基づく映像表示修正
JP5572647B2 (ja) * 2012-02-17 2014-08-13 任天堂株式会社 表示制御プログラム、表示制御装置、表示制御システム、および表示制御方法
US9430055B2 (en) * 2012-06-15 2016-08-30 Microsoft Technology Licensing, Llc Depth of field control for see-thru display
IL221863A (en) * 2012-09-10 2014-01-30 Elbit Systems Ltd Digital video photography system when analyzing and displaying
DE102013212374A1 (de) * 2013-06-27 2014-12-31 Robert Bosch Gmbh Verfahren und Vorrichtung zum Anpassen einer Darstellung eines Bildes auf einem Bildschirm
US10007350B1 (en) * 2014-06-26 2018-06-26 Leap Motion, Inc. Integrated gestural interaction and multi-user collaboration in immersive virtual reality environments
GB2533553B (en) * 2014-12-15 2020-09-09 Sony Interactive Entertainment Inc Image processing method and apparatus
GB2536650A (en) * 2015-03-24 2016-09-28 Augmedics Ltd Method and system for combining video-based and optic-based augmented reality in a near eye display

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102457755A (zh) * 2010-11-05 2012-05-16 乐金显示有限公司 图像显示设备及其驱动方法
WO2013191120A1 (ja) * 2012-06-19 2013-12-27 シャープ株式会社 画像処理装置、方法、プログラム、および記録媒体
CN104766590A (zh) * 2014-01-02 2015-07-08 广达电脑股份有限公司 头戴式显示装置及其背光调整方法
CN105244008A (zh) * 2015-11-09 2016-01-13 深圳市华星光电技术有限公司 一种显示设备及其亮度调节方法

Also Published As

Publication number Publication date
JP2019510991A (ja) 2019-04-18
WO2017114755A1 (en) 2017-07-06
EP3398004B1 (en) 2021-09-29
EP3398004A1 (en) 2018-11-07
CN108885339A (zh) 2018-11-23
US10713760B2 (en) 2020-07-14
US20190012771A1 (en) 2019-01-10
KR20180099703A (ko) 2018-09-05

Similar Documents

Publication Publication Date Title
EP3398004B1 (en) Configuration for rendering virtual reality with an adaptive focal plane
US11010958B2 (en) Method and system for generating an image of a subject in a scene
JP6759371B2 (ja) ３ｄプレノプティックビデオ画像を作成するためのシステムおよび方法
JP6747504B2 (ja) 情報処理装置、情報処理方法、及びプログラム
US20190371072A1 (en) Static occluder
CN105894567B (zh) 放缩三维场景中的用户控制的虚拟对象的像素深度值
US11830148B2 (en) Reconstruction of essential visual cues in mixed reality applications
US20160320863A1 (en) Image processing apparatus and method, and program
US11636656B1 (en) Depth rate up-conversion
US20110228051A1 (en) Stereoscopic Viewing Comfort Through Gaze Estimation
CN109598796A (zh) 将真实场景与虚拟物体进行3d融合显示的方法和装置
JP7148634B2 (ja) ヘッドマウントディスプレイ装置
US20260067439A1 (en) Mono to stereo image conversion and adjustment for viewing on a spatial computer
EP4030752A1 (en) Image generation system and method
KR101172507B1 (ko) 시점 조정 3차원 영상 제공 장치 및 방법
JP7822813B2 (ja) 画像処理装置、画像処理方法およびプログラム
JP2025506420A (ja) 混合モードの没入型テレプレゼンスアプリケーションのための輻輳に基づく注視一致
Moehring et al. Issues with virtual space perception within reaching distance: Mitigating adverse effects on applications using hmds in the automotive industry
JP2012109725A (ja) 立体映像処理装置および立体映像処理方法
KR101704033B1 (ko) 입체영상의 출력 방법
WO2024071208A1 (ja) 表示装置、表示方法及びプログラム
US9609313B2 (en) Enhanced 3D display method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant