JP2019510991A - 適応焦点面を有して仮想現実をレンダリングする構成 - Google Patents

適応焦点面を有して仮想現実をレンダリングする構成 Download PDF

Info

Publication number
JP2019510991A
JP2019510991A JP2018534138A JP2018534138A JP2019510991A JP 2019510991 A JP2019510991 A JP 2019510991A JP 2018534138 A JP2018534138 A JP 2018534138A JP 2018534138 A JP2018534138 A JP 2018534138A JP 2019510991 A JP2019510991 A JP 2019510991A
Authority
JP
Japan
Prior art keywords
virtual reality
processor
field
pixels
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2018534138A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019510991A5 (enExample
Inventor
パインズ，ジョシュア
ロペス，ピーター
キラン ワーラーナシー
キラン ワーラーナシー
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of JP2019510991A publication Critical patent/JP2019510991A/ja
Publication of JP2019510991A5 publication Critical patent/JP2019510991A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
JP2018534138A 2015-12-31 2016-12-22 適応焦点面を有して仮想現実をレンダリングする構成 Pending JP2019510991A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562273833P 2015-12-31 2015-12-31
US62/273,833 2015-12-31
PCT/EP2016/082428 WO2017114755A1 (en) 2015-12-31 2016-12-22 Configuration for rendering virtual reality with an adaptive focal plane

Publications (2)

Publication Number Publication Date
JP2019510991A true JP2019510991A (ja) 2019-04-18
JP2019510991A5 JP2019510991A5 (enExample) 2020-01-23

Family

ID=57681595

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018534138A Pending JP2019510991A (ja) 2015-12-31 2016-12-22 適応焦点面を有して仮想現実をレンダリングする構成

Country Status (6)

Country Link
US (1) US10713760B2 (enExample)
EP (1) EP3398004B1 (enExample)
JP (1) JP2019510991A (enExample)
KR (1) KR20180099703A (enExample)
CN (1) CN108885339B (enExample)
WO (1) WO2017114755A1 (enExample)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9699433B2 (en) * 2013-01-24 2017-07-04 Yuchen Zhou Method and apparatus to produce re-focusable vision with detecting re-focusing event from human eye
WO2019086635A1 (en) * 2017-11-03 2019-05-09 United Screens Gmbh Display system, mobile device and method for providing three-dimensional views
CN107958478B (zh) * 2017-12-15 2022-05-03 歌尔光学科技有限公司 虚拟现实场景中物体的渲染方法和虚拟现实头戴设备
CN108134928A (zh) * 2017-12-26 2018-06-08 深圳Tcl新技术有限公司 Vr显示方法和装置
WO2019182702A2 (en) * 2018-03-22 2019-09-26 Futurewei Technologies, Inc. Immersive media metrics for display information
CN113238651B (zh) * 2018-07-02 2025-02-14 苹果公司 用于显示系统的基于聚焦的调试和检查
CN120856880A (zh) * 2019-03-29 2025-10-28 托比股份公司 利用眼睛的瞳孔增强调节来渲染图像的方法和系统
WO2020209491A1 (en) * 2019-04-11 2020-10-15 Samsung Electronics Co., Ltd. Head-mounted display device and operating method of the same
CN110084879B (zh) * 2019-04-28 2023-06-27 网易（杭州）网络有限公司 虚拟场景中的对象处理方法、装置、介质及电子设备
CN112258612B (zh) * 2019-08-01 2022-04-22 北京灵医灵科技有限公司 一种基于断层图像的虚拟解剖对象观察方法和系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000354257A (ja) * 1999-06-10 2000-12-19 Sony Corp 画像処理装置、画像処理方法、およびプログラム提供媒体
JP2004005567A (ja) * 2002-04-09 2004-01-08 Sony Computer Entertainment America Inc コンピュータディスプレイ画像を生成する方法ならびに画像データを生成するコンピュータ処理システムおよびグラフィックスプロセッサ
JP2006195084A (ja) * 2005-01-12 2006-07-27 Sharp Corp 表示装置
US20120113107A1 (en) * 2010-11-05 2012-05-10 Jun Woo Jang Image display device and driving method for thereof
US20130335404A1 (en) * 2012-06-15 2013-12-19 Jeff Westerinen Depth of field control for see-thru display
JP2015164235A (ja) * 2012-06-19 2015-09-10 シャープ株式会社 画像処理装置、方法、プログラム、および記録媒体

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69333674T2 (de) * 1992-06-02 2006-02-02 Canon K.K. Optisches Gerät zur Rotationsdetektion eines Augapfels eines Beobachters
US20110228051A1 (en) * 2010-03-17 2011-09-22 Goksel Dedeoglu Stereoscopic Viewing Comfort Through Gaze Estimation
JP5529660B2 (ja) * 2010-07-20 2014-06-25 パナソニック株式会社 瞳孔検出装置及び瞳孔検出方法
US8625200B2 (en) * 2010-10-21 2014-01-07 Lockheed Martin Corporation Head-mounted display apparatus employing one or more reflective optical surfaces
US9323325B2 (en) * 2011-08-30 2016-04-26 Microsoft Technology Licensing, Llc Enhancing an object of interest in a see-through, mixed reality display device
EP2761362A2 (en) * 2011-09-26 2014-08-06 Microsoft Corporation Video display modification based on sensor input for a see-through near-to-eye display
JP5572647B2 (ja) * 2012-02-17 2014-08-13 任天堂株式会社 表示制御プログラム、表示制御装置、表示制御システム、および表示制御方法
IL221863A (en) * 2012-09-10 2014-01-30 Elbit Systems Ltd Digital video photography system when analyzing and displaying
DE102013212374A1 (de) * 2013-06-27 2014-12-31 Robert Bosch Gmbh Verfahren und Vorrichtung zum Anpassen einer Darstellung eines Bildes auf einem Bildschirm
TWI516804B (zh) * 2014-01-02 2016-01-11 廣達電腦股份有限公司 頭戴式顯示裝置及其背光調整方法
US10007350B1 (en) * 2014-06-26 2018-06-26 Leap Motion, Inc. Integrated gestural interaction and multi-user collaboration in immersive virtual reality environments
GB2533553B (en) * 2014-12-15 2020-09-09 Sony Interactive Entertainment Inc Image processing method and apparatus
GB2536650A (en) * 2015-03-24 2016-09-28 Augmedics Ltd Method and system for combining video-based and optic-based augmented reality in a near eye display
CN105244008B (zh) * 2015-11-09 2017-12-15 深圳市华星光电技术有限公司 一种显示设备及其亮度调节方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000354257A (ja) * 1999-06-10 2000-12-19 Sony Corp 画像処理装置、画像処理方法、およびプログラム提供媒体
JP2004005567A (ja) * 2002-04-09 2004-01-08 Sony Computer Entertainment America Inc コンピュータディスプレイ画像を生成する方法ならびに画像データを生成するコンピュータ処理システムおよびグラフィックスプロセッサ
JP2006195084A (ja) * 2005-01-12 2006-07-27 Sharp Corp 表示装置
US20120113107A1 (en) * 2010-11-05 2012-05-10 Jun Woo Jang Image display device and driving method for thereof
US20130335404A1 (en) * 2012-06-15 2013-12-19 Jeff Westerinen Depth of field control for see-thru display
JP2015164235A (ja) * 2012-06-19 2015-09-10 シャープ株式会社 画像処理装置、方法、プログラム、および記録媒体

Also Published As

Publication number Publication date
EP3398004B1 (en) 2021-09-29
WO2017114755A1 (en) 2017-07-06
CN108885339B (zh) 2021-09-28
CN108885339A (zh) 2018-11-23
KR20180099703A (ko) 2018-09-05
US10713760B2 (en) 2020-07-14
US20190012771A1 (en) 2019-01-10
EP3398004A1 (en) 2018-11-07

Similar Documents

Publication Publication Date Title
CN108885339B (zh) 用于使用自适应焦平面渲染虚拟现实的配置
US10948726B2 (en) IPD correction and reprojection for accurate mixed reality object placement
US11010958B2 (en) Method and system for generating an image of a subject in a scene
JP6759371B2 (ja) ３ｄプレノプティックビデオ画像を作成するためのシステムおよび方法
JP6747504B2 (ja) 情報処理装置、情報処理方法、及びプログラム
EP3035681B1 (en) Image processing method and apparatus
US9342861B2 (en) Alternate viewpoint rendering
JP2019510991A5 (enExample)
KR20200117685A (ko) 가상 객체 인식 방법, 상기 가상 객체를 이용한 증강 현실 콘텐츠 제공 방법 및 이를 위한 증강 방송 시스템
EP4030752A1 (en) Image generation system and method
JP6017144B2 (ja) 画像処理装置および方法、プログラム、並びに記録媒体
JP6685241B2 (ja) 立体視ビデオ生成
JP6490107B2 (ja) 立体視ビデオズーミング
KR101939243B1 (ko) 입체 깊이 조정 및 초점 조정
US20250148613A1 (en) Image processing method and system

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180703

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191204

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191204

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20201020

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20210518