CN108780578B - 增强现实系统和操作增强现实系统的方法 - Google Patents

增强现实系统和操作增强现实系统的方法 Download PDF

Info

Publication number
CN108780578B
CN108780578B CN201780017089.4A CN201780017089A CN108780578B CN 108780578 B CN108780578 B CN 108780578B CN 201780017089 A CN201780017089 A CN 201780017089A CN 108780578 B CN108780578 B CN 108780578B
Authority
CN
China
Prior art keywords
real object
virtual
image data
overlap region
augmented reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780017089.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN108780578A (zh
Inventor
M·卡斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Priority to CN202310452721.5A priority Critical patent/CN116485929B/zh
Publication of CN108780578A publication Critical patent/CN108780578A/zh
Application granted granted Critical
Publication of CN108780578B publication Critical patent/CN108780578B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/506—Illumination models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/001—Texturing; Colouring; Generation of texture or colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G06T2215/16—Using real world measurements to influence rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2012—Colour editing, changing, or manipulating; Use of colour codes

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Architecture (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Optical Communication System (AREA)
CN201780017089.4A 2016-03-15 2017-03-15 增强现实系统和操作增强现实系统的方法 Active CN108780578B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310452721.5A CN116485929B (zh) 2016-03-15 2017-03-15 增强现实系统和操作增强现实系统的方法

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662308433P 2016-03-15 2016-03-15
US62/308,433 2016-03-15
PCT/US2017/022578 WO2017161039A1 (en) 2016-03-15 2017-03-15 Direct light compensation technique for augmented reality system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202310452721.5A Division CN116485929B (zh) 2016-03-15 2017-03-15 增强现实系统和操作增强现实系统的方法

Publications (2)

Publication Number Publication Date
CN108780578A CN108780578A (zh) 2018-11-09
CN108780578B true CN108780578B (zh) 2023-05-26

Family

ID=59847083

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201780017089.4A Active CN108780578B (zh) 2016-03-15 2017-03-15 增强现实系统和操作增强现实系统的方法
CN202310452721.5A Active CN116485929B (zh) 2016-03-15 2017-03-15 增强现实系统和操作增强现实系统的方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202310452721.5A Active CN116485929B (zh) 2016-03-15 2017-03-15 增强现实系统和操作增强现实系统的方法

Country Status (10)

Country Link
US (2) US10628996B2 (enExample)
EP (2) EP4156167B1 (enExample)
JP (2) JP6750025B2 (enExample)
KR (1) KR102180060B1 (enExample)
CN (2) CN108780578B (enExample)
AU (2) AU2017232527A1 (enExample)
CA (1) CA3016344A1 (enExample)
IL (2) IL261478B (enExample)
NZ (2) NZ786033A (enExample)
WO (1) WO2017161039A1 (enExample)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NZ786033A (en) * 2016-03-15 2023-04-28 Magic Leap Inc Direct light compensation technique for augmented reality system
US10290120B2 (en) * 2017-03-20 2019-05-14 SK Commercial Construction, Inc. Color analysis and control using an electronic mobile device transparent display screen
US10803988B2 (en) * 2017-03-20 2020-10-13 SK Commercial Construction, Inc. Color analysis and control using a transparent display screen on a mobile device with non-transparent, bendable display screen or multiple display screen with 3D sensor for telemedicine diagnosis and treatment
EP3626403B1 (en) * 2017-05-17 2024-09-18 Telexistence Inc. Sensation imparting device, robot control system, and robot control method and program
US10338400B2 (en) 2017-07-03 2019-07-02 Holovisions LLC Augmented reality eyewear with VAPE or wear technology
US10859834B2 (en) 2017-07-03 2020-12-08 Holovisions Space-efficient optical structures for wide field-of-view augmented reality (AR) eyewear
KR102591582B1 (ko) * 2018-06-22 2023-10-19 삼성전자주식회사 컨텐츠를 표시하는 방법 및 전자 장치
TWI675583B (zh) * 2018-07-23 2019-10-21 緯創資通股份有限公司 擴增實境系統及其色彩補償方法
US10909373B1 (en) * 2018-08-24 2021-02-02 Snap Inc. Augmented reality system using structured light
CN111818326B (zh) * 2019-04-12 2022-01-28 广东虚拟现实科技有限公司 图像处理方法、装置、系统、终端设备及存储介质
US11004269B2 (en) * 2019-04-22 2021-05-11 Microsoft Technology Licensing, Llc Blending virtual environments with situated physical reality
CN113874918A (zh) * 2019-05-22 2021-12-31 Pcms控股公司 用于与外部显示器结合来渲染增强现实内容的方法
US11216920B2 (en) 2019-05-31 2022-01-04 Apple Inc. Enhanced local contrast
CN112241199B (zh) 2019-07-19 2023-03-24 华为技术有限公司 虚拟现实场景中的交互方法及装置
EP3819699B1 (en) * 2019-11-08 2024-02-21 Leica Instruments (Singapore) Pte. Ltd. Optical system and corresponding apparatus, method and computer program
US11645756B2 (en) * 2019-11-14 2023-05-09 Samsung Electronics Co., Ltd. Image processing apparatus and method
US11545108B2 (en) * 2020-02-03 2023-01-03 Apple Inc. Modifying rendered image data based on ambient light from a physical environment
US11423621B1 (en) 2020-05-21 2022-08-23 Facebook Technologies, Llc. Adaptive rendering in artificial reality environments
CN111832104B (zh) * 2020-06-24 2023-07-28 深圳市万翼数字技术有限公司 三维设备模型的建立方法及相关设备
US11715405B1 (en) * 2021-02-10 2023-08-01 Sivalogeswaran Ratnasingam Chroma modification based on ambient light characteristics
US12033556B1 (en) * 2021-02-10 2024-07-09 Sivalogeswaran Ratnasingam Per-pixel color correction based on ambient light characteristics
US12003859B2 (en) * 2021-07-16 2024-06-04 Samsung Electronics Co., Ltd. Brightness adjustment method, and apparatus thereof
KR20230103379A (ko) * 2021-12-31 2023-07-07 삼성전자주식회사 Ar 처리 방법 및 장치
CN114419293B (zh) * 2022-01-26 2023-06-06 广州鼎飞航空科技有限公司 一种增强现实的数据处理方法、装置及设备
CN116883607B (zh) * 2023-09-06 2023-12-05 四川物通科技有限公司 基于辐射传输的虚拟现实场景生成系统
CN119359977A (zh) * 2024-10-14 2025-01-24 东南大学 一种基于增强现实显示设备测量对比敏感度的方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103930818A (zh) * 2011-09-12 2014-07-16 谷歌公司 具有虚拟图像对比度控制的光学显示系统和方法
WO2014156033A1 (en) * 2013-03-26 2014-10-02 Seiko Epson Corporation Head-mounted display device, control method of head-mounted display device, and display system
CN104952063A (zh) * 2014-03-25 2015-09-30 Metaio有限公司 用于在真实环境的视图中表示虚拟对象的方法和系统

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3450792B2 (ja) 1999-03-25 2003-09-29 キヤノン株式会社 奥行き画像計測装置及び方法、並びに複合現実感提示システム
JP2002148559A (ja) * 2000-11-15 2002-05-22 Mixed Reality Systems Laboratory Inc 画像観察装置及びそれを用いた画像観察システム
US10187589B2 (en) * 2008-12-19 2019-01-22 Saab Ab System and method for mixing a scene with a virtual scenario
JP5136442B2 (ja) * 2009-01-27 2013-02-06 ブラザー工業株式会社 ヘッドマウントディスプレイ
US8107084B2 (en) * 2009-01-30 2012-01-31 Zygo Corporation Interference microscope with scan motion detection using fringe motion in monitor patterns
US9323325B2 (en) * 2011-08-30 2016-04-26 Microsoft Technology Licensing, Llc Enhancing an object of interest in a see-through, mixed reality display device
US9734633B2 (en) * 2012-01-27 2017-08-15 Microsoft Technology Licensing, Llc Virtual environment generating system
US9147111B2 (en) * 2012-02-10 2015-09-29 Microsoft Technology Licensing, Llc Display with blocking image generation
CN103472909B (zh) * 2012-04-10 2017-04-12 微软技术许可有限责任公司 用于头戴式、增强现实显示器的逼真遮挡
US20130328925A1 (en) * 2012-06-12 2013-12-12 Stephen G. Latta Object focus in a mixed reality environment
US9430055B2 (en) * 2012-06-15 2016-08-30 Microsoft Technology Licensing, Llc Depth of field control for see-thru display
US9158114B2 (en) * 2012-11-05 2015-10-13 Exelis Inc. Image display utilizing a variable mask to selectively block image data
JP6273677B2 (ja) 2013-02-28 2018-02-07 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
EP3129980B1 (en) * 2014-07-18 2021-08-25 Vuzix Corporation Near-eye display with self-emitting microdisplay engine
US10313656B2 (en) * 2014-09-22 2019-06-04 Samsung Electronics Company Ltd. Image stitching for three-dimensional video
US10345899B2 (en) * 2014-12-22 2019-07-09 Essilor International Method for adapting the sensorial output mode of a sensorial output device to a user
NZ786033A (en) * 2016-03-15 2023-04-28 Magic Leap Inc Direct light compensation technique for augmented reality system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103930818A (zh) * 2011-09-12 2014-07-16 谷歌公司 具有虚拟图像对比度控制的光学显示系统和方法
WO2014156033A1 (en) * 2013-03-26 2014-10-02 Seiko Epson Corporation Head-mounted display device, control method of head-mounted display device, and display system
CN104952063A (zh) * 2014-03-25 2015-09-30 Metaio有限公司 用于在真实环境的视图中表示虚拟对象的方法和系统

Also Published As

Publication number Publication date
EP4156167A1 (en) 2023-03-29
IL287369A (en) 2021-12-01
EP3430610A4 (en) 2019-02-06
IL261478B (en) 2021-12-01
EP4156167B1 (en) 2025-08-06
CN108780578A (zh) 2018-11-09
NZ745790A (en) 2023-04-28
JP2019517012A (ja) 2019-06-20
WO2017161039A1 (en) 2017-09-21
EP3430610B1 (en) 2022-12-07
US20200211273A1 (en) 2020-07-02
US20170270707A1 (en) 2017-09-21
NZ786033A (en) 2023-04-28
AU2022201635A1 (en) 2022-03-31
JP6750025B2 (ja) 2020-09-02
AU2017232527A1 (en) 2018-09-20
CA3016344A1 (en) 2017-09-21
CN116485929B (zh) 2024-07-26
US11257285B2 (en) 2022-02-22
KR102180060B1 (ko) 2020-11-17
EP3430610A1 (en) 2019-01-23
IL287369B2 (en) 2023-06-01
IL261478A (en) 2018-10-31
CN116485929A (zh) 2023-07-25
KR20180122690A (ko) 2018-11-13
JP2020198115A (ja) 2020-12-10
US10628996B2 (en) 2020-04-21
JP7054406B2 (ja) 2022-04-13

Similar Documents

Publication Publication Date Title
CN108780578B (zh) 增强现实系统和操作增强现实系统的方法
JP7606023B2 (ja) 仮想コンテンツワーピングを伴う複合現実システムおよびそれを使用して仮想コンテンツを生成する方法
US11978175B2 (en) Mixed reality system with color virtual content warping and method of generating virtual content using same
US10313661B2 (en) Wide baseline stereo for low-latency rendering
JP7036879B2 (ja) 仮想画像生成システムにおけるテキストをより効率的に表示するための技法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant