JP7123127B2 - 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成 - Google Patents

前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成 Download PDF

Info

Publication number
JP7123127B2
JP7123127B2 JP2020512591A JP2020512591A JP7123127B2 JP 7123127 B2 JP7123127 B2 JP 7123127B2 JP 2020512591 A JP2020512591 A JP 2020512591A JP 2020512591 A JP2020512591 A JP 2020512591A JP 7123127 B2 JP7123127 B2 JP 7123127B2
Authority
JP
Japan
Prior art keywords
content
eye
objects
rendered
line
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020512591A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020532797A5 (enExample
JP2020532797A (ja
Inventor
レザ ヌーライ，
ロバート ブレイク テイラー，
マイケル ハロルド リーベナウ，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2020532797A publication Critical patent/JP2020532797A/ja
Publication of JP2020532797A5 publication Critical patent/JP2020532797A5/ja
Priority to JP2022126805A priority Critical patent/JP7166484B1/ja
Application granted granted Critical
Publication of JP7123127B2 publication Critical patent/JP7123127B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/60—Memory management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/40—Hidden part removal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/62—Semi-transparency

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optics & Photonics (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Circuits Of Receivers In General (AREA)
  • Image Generation (AREA)
  • Controls And Circuits For Display Device (AREA)
JP2020512591A 2017-09-01 2018-08-31 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成 Active JP7123127B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022126805A JP7166484B1 (ja) 2017-09-01 2022-08-09 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762553778P 2017-09-01 2017-09-01
US62/553,778 2017-09-01
PCT/US2018/049266 WO2019046821A1 (en) 2017-09-01 2018-08-31 GENERATING A NEW FRAME USING REBUILDED CONTENT AND UNRESTITUDED CONTENT FROM A PREVIOUS PERSPECTIVE

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2022126805A Division JP7166484B1 (ja) 2017-09-01 2022-08-09 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成

Publications (3)

Publication Number Publication Date
JP2020532797A JP2020532797A (ja) 2020-11-12
JP2020532797A5 JP2020532797A5 (enExample) 2021-10-07
JP7123127B2 true JP7123127B2 (ja) 2022-08-22

Family

ID=65518123

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2020512591A Active JP7123127B2 (ja) 2017-09-01 2018-08-31 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成
JP2022126805A Active JP7166484B1 (ja) 2017-09-01 2022-08-09 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成
JP2022170457A Active JP7201869B1 (ja) 2017-09-01 2022-10-25 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2022126805A Active JP7166484B1 (ja) 2017-09-01 2022-08-09 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成
JP2022170457A Active JP7201869B1 (ja) 2017-09-01 2022-10-25 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成

Country Status (9)

Country Link
US (3) US10489966B2 (enExample)
EP (2) EP4177667B1 (enExample)
JP (3) JP7123127B2 (enExample)
KR (2) KR102379670B1 (enExample)
CN (2) CN114897754B (enExample)
AU (1) AU2018326807B2 (enExample)
CA (1) CA3073618A1 (enExample)
IL (2) IL272651B (enExample)
WO (1) WO2019046821A1 (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110266955B (zh) * 2019-06-28 2021-01-26 Oppo广东移动通信有限公司 图像处理方法、装置、电子设备以及存储介质
US11538199B2 (en) * 2020-02-07 2022-12-27 Lenovo (Singapore) Pte. Ltd. Displaying a window in an augmented reality view
KR102368953B1 (ko) * 2020-02-18 2022-03-03 페디셈 주식회사 가상 현실 공간 제공 방법 및 시스템
CN111627116B (zh) * 2020-05-29 2024-02-27 联想(北京)有限公司 图像渲染控制方法、装置及服务器
WO2022005707A1 (en) 2020-06-29 2022-01-06 Limonox Projects Llc Method and device for multi-camera hole filling
US11822713B2 (en) 2021-06-11 2023-11-21 Rockwell Collins, Inc. Pose augmentation of head worn display video for latency reduction
CN113721874A (zh) * 2021-07-29 2021-11-30 阿里巴巴（中国）有限公司 虚拟现实画面显示方法及电子设备
CN113963103A (zh) * 2021-10-26 2022-01-21 中国银行股份有限公司 一种三维模型的渲染方法和相关装置
US20240056563A1 (en) * 2022-08-12 2024-02-15 Apple Inc. Transparent Display with Blur Effect for Physical Objects

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004525437A (ja) 2000-12-01 2004-08-19 サーノフ コーポレイション 一群の実際のビデオおよび／または静止画像から新規ビデオおよび／または静止画像を合成する方法および装置

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100450823B1 (ko) * 2001-11-27 2004-10-01 삼성전자주식회사 깊이 이미지 기반 3차원 물체의 표현을 위한 노드 구조
US7883415B2 (en) * 2003-09-15 2011-02-08 Sony Computer Entertainment Inc. Method and apparatus for adjusting a view of a scene being displayed according to tracked head motion
JP5299173B2 (ja) * 2009-08-26 2013-09-25 ソニー株式会社 画像処理装置および画像処理方法、並びにプログラム
US20110279446A1 (en) 2010-05-16 2011-11-17 Nokia Corporation Method and apparatus for rendering a perspective view of objects and content related thereto for location-based services on mobile device
EP2617025B1 (en) * 2010-09-13 2019-05-08 Barry Lynn Jenkins Delivering and controlling streaming interactive media comprising renderable geometric, texture and lighting data
US9424767B2 (en) * 2012-06-18 2016-08-23 Microsoft Technology Licensing, Llc Local rendering of text in image
CN105229719B (zh) 2013-03-15 2018-04-27 奇跃公司 显示系统和方法
WO2015006784A2 (en) 2013-07-12 2015-01-15 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US9729317B2 (en) * 2014-01-30 2017-08-08 Mentor Graphics Corporation Optical physical uncloneable function
US10200627B2 (en) * 2014-04-09 2019-02-05 Imagination Technologies Limited Virtual camera for 3-D modeling applications
WO2016038240A1 (en) * 2014-09-09 2016-03-17 Nokia Technologies Oy Stereo image recording and playback
US9240069B1 (en) * 2015-06-30 2016-01-19 Ariadne's Thread (Usa), Inc. Low-latency virtual reality display system
US10147211B2 (en) * 2015-07-15 2018-12-04 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
WO2017112013A1 (en) * 2015-12-22 2017-06-29 Google Inc. System and method for performing electronic display stabilization via retained lightfield rendering
CN110431601A (zh) * 2017-03-23 2019-11-08 索尼互动娱乐股份有限公司 信息处理装置
GB201709752D0 (en) * 2017-06-19 2017-08-02 Advanced Risc Mach Ltd Graphics processing systems
EP3419286A1 (en) * 2017-06-23 2018-12-26 Koninklijke Philips N.V. Processing of 3d image information based on texture maps and meshes

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004525437A (ja) 2000-12-01 2004-08-19 サーノフ コーポレイション 一群の実際のビデオおよび／または静止画像から新規ビデオおよび／または静止画像を合成する方法および装置

Also Published As

Publication number Publication date
US10846912B2 (en) 2020-11-24
IL272651A (en) 2020-03-31
KR20220041252A (ko) 2022-03-31
AU2018326807B2 (en) 2023-04-13
EP4177667A1 (en) 2023-05-10
IL294397A (en) 2022-08-01
IL294397B2 (en) 2024-02-01
CN111051959B (zh) 2022-06-03
JP2023015119A (ja) 2023-01-31
WO2019046821A1 (en) 2019-03-07
US20200051322A1 (en) 2020-02-13
KR102379670B1 (ko) 2022-03-25
CN114897754A (zh) 2022-08-12
US20210035353A1 (en) 2021-02-04
JP7201869B1 (ja) 2023-01-10
CN111051959A (zh) 2020-04-21
US20190073821A1 (en) 2019-03-07
CA3073618A1 (en) 2019-03-07
AU2018326807A1 (en) 2020-03-05
JP2020532797A (ja) 2020-11-12
EP3676653B1 (en) 2023-02-15
KR102680570B1 (ko) 2024-07-01
EP3676653A1 (en) 2020-07-08
IL272651B (en) 2022-08-01
CN114897754B (zh) 2024-04-09
US11288858B2 (en) 2022-03-29
EP4177667B1 (en) 2025-03-12
IL294397B1 (en) 2023-10-01
EP3676653A4 (en) 2020-10-07
JP7166484B1 (ja) 2022-11-07
US10489966B2 (en) 2019-11-26
JP2022179473A (ja) 2022-12-02
KR20200046048A (ko) 2020-05-06

Similar Documents

Publication Publication Date Title
JP7201869B1 (ja) 前の目線からのレンダリングされたコンテンツおよびレンダリングされなかったコンテンツを使用した新しいフレームの生成
JP7443602B2 (ja) 仮想コンテンツワーピングを伴う複合現実システムおよびそれを使用して仮想コンテンツを生成する方法
AU2022200841B2 (en) Mixed reality system with multi-source virtual content compositing and method of generating virtual content using same
AU2018236457B2 (en) Mixed reality system with virtual content warping and method of generating virtual content using same

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210830

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210830

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20210830

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20211227

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220125

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220420

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220712

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220809

R150 Certificate of patent or registration of utility model

Ref document number: 7123127

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250