KR102680570B1 - 이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성 - Google Patents

이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성 Download PDF

Info

Publication number
KR102680570B1
KR102680570B1 KR1020227009732A KR20227009732A KR102680570B1 KR 102680570 B1 KR102680570 B1 KR 102680570B1 KR 1020227009732 A KR1020227009732 A KR 1020227009732A KR 20227009732 A KR20227009732 A KR 20227009732A KR 102680570 B1 KR102680570 B1 KR 102680570B1
Authority
KR
South Korea
Prior art keywords
perspective
rendered content
objects
rendered
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020227009732A
Other languages
English (en)
Korean (ko)
Other versions
KR20220041252A (ko
Inventor
레자 누라이
로버트 블레이크 테일러
마이클 해럴드 리베나우
Original Assignee
매직 립, 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 매직 립, 인코포레이티드 filed Critical 매직 립, 인코포레이티드
Publication of KR20220041252A publication Critical patent/KR20220041252A/ko
Application granted granted Critical
Publication of KR102680570B1 publication Critical patent/KR102680570B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/40—Hidden part removal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/60—Memory management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/62—Semi-transparency

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Circuits Of Receivers In General (AREA)
  • Image Generation (AREA)
  • Controls And Circuits For Display Device (AREA)
KR1020227009732A 2017-09-01 2018-08-31 이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성 Active KR102680570B1 (ko)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201762553778P 2017-09-01 2017-09-01
US62/553,778 2017-09-01
PCT/US2018/049266 WO2019046821A1 (en) 2017-09-01 2018-08-31 GENERATING A NEW FRAME USING REBUILDED CONTENT AND UNRESTITUDED CONTENT FROM A PREVIOUS PERSPECTIVE
KR1020207007380A KR102379670B1 (ko) 2017-09-01 2018-08-31 이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
KR1020207007380A Division KR102379670B1 (ko) 2017-09-01 2018-08-31 이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성

Publications (2)

Publication Number Publication Date
KR20220041252A KR20220041252A (ko) 2022-03-31
KR102680570B1 true KR102680570B1 (ko) 2024-07-01

Family

ID=65518123

Family Applications (2)

Application Number Title Priority Date Filing Date
KR1020227009732A Active KR102680570B1 (ko) 2017-09-01 2018-08-31 이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성
KR1020207007380A Active KR102379670B1 (ko) 2017-09-01 2018-08-31 이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성

Family Applications After (1)

Application Number Title Priority Date Filing Date
KR1020207007380A Active KR102379670B1 (ko) 2017-09-01 2018-08-31 이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성

Country Status (9)

Country Link
US (3) US10489966B2 (https=)
EP (2) EP4177667B1 (https=)
JP (3) JP7123127B2 (https=)
KR (2) KR102680570B1 (https=)
CN (2) CN114897754B (https=)
AU (1) AU2018326807B2 (https=)
CA (1) CA3073618A1 (https=)
IL (2) IL294397B2 (https=)
WO (1) WO2019046821A1 (https=)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110266955B (zh) * 2019-06-28 2021-01-26 Oppo广东移动通信有限公司 图像处理方法、装置、电子设备以及存储介质
US11538199B2 (en) * 2020-02-07 2022-12-27 Lenovo (Singapore) Pte. Ltd. Displaying a window in an augmented reality view
KR102368953B1 (ko) * 2020-02-18 2022-03-03 페디셈 주식회사 가상 현실 공간 제공 방법 및 시스템
CN111627116B (zh) * 2020-05-29 2024-02-27 联想(北京)有限公司 图像渲染控制方法、装置及服务器
KR20250108754A (ko) 2020-06-29 2025-07-15 애플 인크. 다중 카메라 홀 충전을 위한 방법 및 디바이스
US11822713B2 (en) 2021-06-11 2023-11-21 Rockwell Collins, Inc. Pose augmentation of head worn display video for latency reduction
CN113721874A (zh) * 2021-07-29 2021-11-30 阿里巴巴（中国）有限公司 虚拟现实画面显示方法及电子设备
CN113963103A (zh) * 2021-10-26 2022-01-21 中国银行股份有限公司 一种三维模型的渲染方法和相关装置
US20230342877A1 (en) * 2022-04-20 2023-10-26 Snap Inc. Cached cloud rendering
US20240056563A1 (en) * 2022-08-12 2024-02-15 Apple Inc. Transparent Display with Blur Effect for Physical Objects

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7085409B2 (en) * 2000-10-18 2006-08-01 Sarnoff Corporation Method and apparatus for synthesizing new video and/or still imagery from a collection of real video and/or still imagery
KR100446635B1 (ko) * 2001-11-27 2004-09-04 삼성전자주식회사 깊이 이미지 기반 3차원 객체 표현 장치 및 방법
US7883415B2 (en) 2003-09-15 2011-02-08 Sony Computer Entertainment Inc. Method and apparatus for adjusting a view of a scene being displayed according to tracked head motion
JP5299173B2 (ja) * 2009-08-26 2013-09-25 ソニー株式会社 画像処理装置および画像処理方法、並びにプログラム
US20110279446A1 (en) 2010-05-16 2011-11-17 Nokia Corporation Method and apparatus for rendering a perspective view of objects and content related thereto for location-based services on mobile device
CN107093201B (zh) 2010-09-13 2021-02-12 巴里·林恩·詹金斯 传输和控制包括渲染的几何、纹理和光照数据的流交互媒体
US9424767B2 (en) * 2012-06-18 2016-08-23 Microsoft Technology Licensing, Llc Local rendering of text in image
CN105229719B (zh) * 2013-03-15 2018-04-27 奇跃公司 显示系统和方法
WO2015006784A2 (en) 2013-07-12 2015-01-15 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US9729317B2 (en) 2014-01-30 2017-08-08 Mentor Graphics Corporation Optical physical uncloneable function
US10200627B2 (en) * 2014-04-09 2019-02-05 Imagination Technologies Limited Virtual camera for 3-D modeling applications
WO2016038240A1 (en) * 2014-09-09 2016-03-17 Nokia Technologies Oy Stereo image recording and playback
US9240069B1 (en) * 2015-06-30 2016-01-19 Ariadne's Thread (Usa), Inc. Low-latency virtual reality display system
US10147211B2 (en) * 2015-07-15 2018-12-04 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
WO2017112013A1 (en) * 2015-12-22 2017-06-29 Google Inc. System and method for performing electronic display stabilization via retained lightfield rendering
JP6775669B2 (ja) * 2017-03-23 2020-10-28 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置
GB201709752D0 (en) * 2017-06-19 2017-08-02 Advanced Risc Mach Ltd Graphics processing systems
EP3419286A1 (en) 2017-06-23 2018-12-26 Koninklijke Philips N.V. Processing of 3d image information based on texture maps and meshes

Also Published As

Publication number Publication date
KR20200046048A (ko) 2020-05-06
IL294397B2 (en) 2024-02-01
EP4177667B1 (en) 2025-03-12
EP3676653B1 (en) 2023-02-15
JP2022179473A (ja) 2022-12-02
JP7201869B1 (ja) 2023-01-10
IL272651B (en) 2022-08-01
JP2023015119A (ja) 2023-01-31
KR102379670B1 (ko) 2022-03-25
JP7123127B2 (ja) 2022-08-22
IL294397B1 (en) 2023-10-01
US20210035353A1 (en) 2021-02-04
AU2018326807B2 (en) 2023-04-13
CA3073618A1 (en) 2019-03-07
JP7166484B1 (ja) 2022-11-07
EP3676653A1 (en) 2020-07-08
KR20220041252A (ko) 2022-03-31
CN114897754B (zh) 2024-04-09
JP2020532797A (ja) 2020-11-12
AU2018326807A1 (en) 2020-03-05
US20200051322A1 (en) 2020-02-13
US10489966B2 (en) 2019-11-26
US20190073821A1 (en) 2019-03-07
CN111051959B (zh) 2022-06-03
WO2019046821A1 (en) 2019-03-07
US11288858B2 (en) 2022-03-29
CN114897754A (zh) 2022-08-12
IL294397A (en) 2022-08-01
IL272651A (en) 2020-03-31
EP4177667A1 (en) 2023-05-10
US10846912B2 (en) 2020-11-24
CN111051959A (zh) 2020-04-21
EP3676653A4 (en) 2020-10-07

Similar Documents

Publication Publication Date Title
KR102680570B1 (ko) 이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성
US12190468B2 (en) Mixed reality system with virtual content warping and method of generating virtual content using same
AU2022200841B2 (en) Mixed reality system with multi-source virtual content compositing and method of generating virtual content using same
JP2023124678A (ja) 画像処理装置、画像処理方法、及び画像処理プログラム

Legal Events

Date Code Title Description
A107 Divisional application of patent
PA0104 Divisional application for international application

Comment text: Divisional Application for International Patent

Patent event code: PA01041R01D

Patent event date: 20220323

Application number text: 1020207007380

Filing date: 20200312

PA0201 Request for examination
PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20231005

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20240328

PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20240627

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20240627

End annual number: 3

Start annual number: 1

PG1601 Publication of registration