JP2016522485A - 再構成からの隠消現実感効果および媒介現実感効果 - Google Patents

再構成からの隠消現実感効果および媒介現実感効果 Download PDF

Info

Publication number
JP2016522485A
JP2016522485A JP2016511738A JP2016511738A JP2016522485A JP 2016522485 A JP2016522485 A JP 2016522485A JP 2016511738 A JP2016511738 A JP 2016511738A JP 2016511738 A JP2016511738 A JP 2016511738A JP 2016522485 A JP2016522485 A JP 2016522485A
Authority
JP
Japan
Prior art keywords
image
mask
pixel
virtual
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2016511738A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016522485A5 (OSRAM
Inventor
ディーター・シュマルスティーグ
Original Assignee
クアルコム，インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by クアルコム，インコーポレイテッド filed Critical クアルコム，インコーポレイテッド
Publication of JP2016522485A publication Critical patent/JP2016522485A/ja
Publication of JP2016522485A5 publication Critical patent/JP2016522485A5/ja
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Telephone Function (AREA)
  • Image Analysis (AREA)
JP2016511738A 2013-04-30 2014-03-26 再構成からの隠消現実感効果および媒介現実感効果 Pending JP2016522485A (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201361817792P 2013-04-30 2013-04-30
US61/817,792 2013-04-30
US14/225,157 US9269003B2 (en) 2013-04-30 2014-03-25 Diminished and mediated reality effects from reconstruction
US14/225,157 2014-03-25
PCT/US2014/031926 WO2014178966A1 (en) 2013-04-30 2014-03-26 Diminished and mediated reality effects from reconstruction

Publications (2)

Publication Number Publication Date
JP2016522485A true JP2016522485A (ja) 2016-07-28
JP2016522485A5 JP2016522485A5 (OSRAM) 2017-04-13

Family

ID=51789286

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016511738A Pending JP2016522485A (ja) 2013-04-30 2014-03-26 再構成からの隠消現実感効果および媒介現実感効果

Country Status (5)

Country Link
US (1) US9269003B2 (OSRAM)
EP (1) EP2992508B1 (OSRAM)
JP (1) JP2016522485A (OSRAM)
CN (1) CN105164728B (OSRAM)
WO (1) WO2014178966A1 (OSRAM)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018129026A (ja) * 2017-02-07 2018-08-16 日本電信電話株式会社 決定装置、画像処理装置、決定方法及び決定プログラム
KR20190036868A (ko) * 2017-09-28 2019-04-05 한국과학기술원 가시광 통신을 이용한 실내공간의 증강현실 제공 시스템 및 그 방법
JP2019091436A (ja) * 2017-10-18 2019-06-13 ダッソー システムズＤａｓｓａｕｌｔ Ｓｙｓｔｅｍｅｓ ３ｄ配置のタイプに応じた２ｄ画像の分類
JP2019152899A (ja) * 2018-02-28 2019-09-12 株式会社バンダイナムコスタジオ シミュレーションシステム及びプログラム
US11645822B2 (en) 2020-12-21 2023-05-09 Toyota Jidosha Kabushiki Kaisha Display system and display device for rendering of a virtual object of a departure point
WO2025163772A1 (ja) * 2024-01-30 2025-08-07 Ｎｔｔ株式会社 映像処理装置
WO2025238724A1 (ja) * 2024-05-14 2025-11-20 Ｎｔｔ株式会社 情報提示装置、情報提示方法およびプログラム

Families Citing this family (92)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US9811731B2 (en) * 2013-10-04 2017-11-07 Qualcomm Incorporated Dynamic extension of map data for object detection and tracking
US9607437B2 (en) * 2013-10-04 2017-03-28 Qualcomm Incorporated Generating augmented reality content for unknown objects
US9704295B2 (en) * 2013-11-05 2017-07-11 Microsoft Technology Licensing, Llc Construction of synthetic augmented reality environment
US10484697B2 (en) * 2014-09-09 2019-11-19 Qualcomm Incorporated Simultaneous localization and mapping for video coding
US9607388B2 (en) * 2014-09-19 2017-03-28 Qualcomm Incorporated System and method of pose estimation
US9710960B2 (en) 2014-12-04 2017-07-18 Vangogh Imaging, Inc. Closed-form 3D model generation of non-rigid complex objects from incomplete and noisy scans
US10838207B2 (en) 2015-03-05 2020-11-17 Magic Leap, Inc. Systems and methods for augmented reality
US10180734B2 (en) 2015-03-05 2019-01-15 Magic Leap, Inc. Systems and methods for augmented reality
EP3265866B1 (en) 2015-03-05 2022-12-28 Magic Leap, Inc. Systems and methods for augmented reality
US10304203B2 (en) 2015-05-14 2019-05-28 Qualcomm Incorporated Three-dimensional model generation
US9911242B2 (en) 2015-05-14 2018-03-06 Qualcomm Incorporated Three-dimensional model generation
US10373366B2 (en) 2015-05-14 2019-08-06 Qualcomm Incorporated Three-dimensional model generation
US20160358382A1 (en) * 2015-06-04 2016-12-08 Vangogh Imaging, Inc. Augmented Reality Using 3D Depth Sensor and 3D Projection
EP3115969B1 (en) 2015-07-09 2021-01-06 Nokia Technologies Oy Mediated reality
US10388069B2 (en) 2015-09-09 2019-08-20 Futurewei Technologies, Inc. Methods and systems for light field augmented reality/virtual reality on mobile devices
US20170083790A1 (en) * 2015-09-23 2017-03-23 Behavioral Recognition Systems, Inc. Detected object tracker for a video analytics system
CN108604383A (zh) 2015-12-04 2018-09-28 奇跃公司 重新定位系统和方法
US10165171B2 (en) 2016-01-22 2018-12-25 Coban Technologies, Inc. Systems, apparatuses, and methods for controlling audiovisual apparatuses
WO2017136833A1 (en) * 2016-02-05 2017-08-10 Magic Leap, Inc. Systems and methods for augmented reality
US10370102B2 (en) 2016-05-09 2019-08-06 Coban Technologies, Inc. Systems, apparatuses and methods for unmanned aerial vehicle
US10789840B2 (en) 2016-05-09 2020-09-29 Coban Technologies, Inc. Systems, apparatuses and methods for detecting driving behavior and triggering actions based on detected driving behavior
US10152858B2 (en) 2016-05-09 2018-12-11 Coban Technologies, Inc. Systems, apparatuses and methods for triggering actions based on data capture and characterization
CN106023179A (zh) * 2016-05-13 2016-10-12 江苏科技大学 基于几何活动轮廓模型的sar图像海岸线提取方法
US11024088B2 (en) 2016-05-27 2021-06-01 HoloBuilder, Inc. Augmented and virtual reality
JP2019522288A (ja) * 2016-06-24 2019-08-08 ローベルト ボツシユ ゲゼルシヤフト ミツト ベシユレンクテル ハフツングＲｏｂｅｒｔ Ｂｏｓｃｈ Ｇｍｂｈ Ｒｇｂ−ｄカメラに基づく追跡システム及びその方法
JP6972105B2 (ja) 2016-08-02 2021-11-24 マジック リープ, インコーポレイテッドMagic Leap, Inc. 固定距離の仮想現実システムおよび拡張現実システムならびに方法
EP4184438B1 (en) * 2016-08-30 2025-10-29 Snap Inc. Systems and methods for simultaneous localization and mapping
US10380762B2 (en) 2016-10-07 2019-08-13 Vangogh Imaging, Inc. Real-time remote collaboration and virtual presence using simultaneous localization and mapping to construct a 3D model and update a scene based on sparse data
US10341568B2 (en) 2016-10-10 2019-07-02 Qualcomm Incorporated User interface to assist three dimensional scanning of objects
US10593116B2 (en) 2016-10-24 2020-03-17 Snap Inc. Augmented reality object manipulation
JP6854344B2 (ja) 2016-11-15 2021-04-07 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 直方体検出のための深層機械学習システム
US10210662B2 (en) 2016-12-09 2019-02-19 Fyusion, Inc. Live augmented reality using tracking
US10665024B2 (en) 2016-12-12 2020-05-26 Fyusion, Inc. Providing recording guidance in generating a multi-view interactive digital media representation
US9996945B1 (en) 2016-12-12 2018-06-12 Fyusion, Inc. Live augmented reality guides
US10242503B2 (en) 2017-01-09 2019-03-26 Snap Inc. Surface aware lens
US10812936B2 (en) 2017-01-23 2020-10-20 Magic Leap, Inc. Localization determination for mixed reality systems
US20180210628A1 (en) 2017-01-23 2018-07-26 Snap Inc. Three-dimensional interaction system
US20200045298A1 (en) * 2017-02-27 2020-02-06 Thomson Licensing Method, system and apparatus for visual effects
KR102841075B1 (ko) 2017-03-17 2025-07-30 매직 립, 인코포레이티드 컬러 가상 콘텐츠 워핑을 갖는 혼합 현실 시스템 및 이를 사용하여 가상 콘텐츠를 생성하는 방법
AU2018236457B2 (en) * 2017-03-17 2021-04-29 Magic Leap, Inc. Mixed reality system with virtual content warping and method of generating virtual content using same
CN117197403B (zh) 2017-03-17 2025-02-25 奇跃公司 混合现实系统及使用该系统生成虚拟内容的方法
AU2018234929B2 (en) * 2017-03-17 2022-06-30 Magic Leap, Inc. Technique for recording augmented reality data
CN107170011B (zh) * 2017-04-24 2019-12-17 杭州艾芯智能科技有限公司 一种机器人视觉跟踪方法及系统
TWI660156B (zh) * 2017-04-28 2019-05-21 宏達國際電子股份有限公司 追蹤系統及方法
WO2018213131A1 (en) * 2017-05-18 2018-11-22 Pcms Holdings, Inc. System and method for distributing and rendering content as spherical video and 3d asset combination
US11778154B2 (en) * 2017-08-09 2023-10-03 Apple Inc. Low latency chroma keying embedded in a head-mounted display for mixed reality
US10474900B2 (en) 2017-09-15 2019-11-12 Snap Inc. Real-time tracking-compensated image effects
US10817983B1 (en) * 2017-09-28 2020-10-27 Apple Inc. Method and device for combining real and virtual images
WO2019081350A1 (en) * 2017-10-23 2019-05-02 Koninklijke Philips N.V. SERVICE INSTRUCTION LIBRARY BASED ON SELF-EXPANSION ENHANCED REALITY
US10839585B2 (en) 2018-01-05 2020-11-17 Vangogh Imaging, Inc. 4D hologram: real-time remote avatar creation and animation control
US11080540B2 (en) 2018-03-20 2021-08-03 Vangogh Imaging, Inc. 3D vision processing using an IP block
US10810783B2 (en) 2018-04-03 2020-10-20 Vangogh Imaging, Inc. Dynamic real-time texture alignment for 3D models
US11170224B2 (en) 2018-05-25 2021-11-09 Vangogh Imaging, Inc. Keyframe-based object scanning and tracking
WO2020023523A1 (en) 2018-07-23 2020-01-30 Magic Leap, Inc. Intra-field sub code timing in field sequential displays
CN112513712B (zh) 2018-07-23 2023-05-09 奇跃公司 具有虚拟内容翘曲的混合现实系统和使用该系统生成虚拟内容的方法
CN109272457B (zh) * 2018-08-09 2022-07-22 腾讯科技（深圳）有限公司 一种图像掩膜生成方法、装置及服务器
US11030813B2 (en) 2018-08-30 2021-06-08 Snap Inc. Video clip object tracking
CN111182174B (zh) * 2018-11-09 2020-12-04 珠海格力电器股份有限公司 一种扫地机器人补光的方法及装置
US11410398B2 (en) * 2018-11-21 2022-08-09 Hewlett-Packard Development Company, L.P. Augmenting live images of a scene for occlusion
US11176737B2 (en) 2018-11-27 2021-11-16 Snap Inc. Textured mesh building
US11501499B2 (en) 2018-12-20 2022-11-15 Snap Inc. Virtual surface modification
US10984575B2 (en) 2019-02-06 2021-04-20 Snap Inc. Body pose estimation
EP3948840A4 (en) * 2019-03-18 2023-07-19 Geomagical Labs, Inc. VIRTUAL INTERACTION WITH THREE-DIMENSIONAL INTERIOR ROOM IMAGING
US11232633B2 (en) 2019-05-06 2022-01-25 Vangogh Imaging, Inc. 3D object capture and object reconstruction using edge cloud computing resources
US11170552B2 (en) 2019-05-06 2021-11-09 Vangogh Imaging, Inc. Remote visualization of three-dimensional (3D) animation with synchronized voice in real-time
US11189098B2 (en) 2019-06-28 2021-11-30 Snap Inc. 3D object camera customization system
US11164384B2 (en) * 2019-07-24 2021-11-02 Houzz, Inc. Mobile device image item replacements
CN110446092B (zh) * 2019-07-25 2023-06-20 北京拉近众博科技有限公司 用于体育比赛的虚拟观众席生成方法、系统、装置和介质
US11232646B2 (en) 2019-09-06 2022-01-25 Snap Inc. Context-based virtual object rendering
CN112734797B (zh) * 2019-10-29 2024-12-10 浙江商汤科技开发有限公司 图像特征跟踪方法、装置及电子设备
US11227442B1 (en) 2019-12-19 2022-01-18 Snap Inc. 3D captions with semantic graphical elements
US11263817B1 (en) 2019-12-19 2022-03-01 Snap Inc. 3D captions with face tracking
US10976806B1 (en) * 2019-12-27 2021-04-13 GE Precision Healthcare LLC Methods and systems for immersive reality in a medical environment
US11335063B2 (en) 2020-01-03 2022-05-17 Vangogh Imaging, Inc. Multiple maps for 3D object scanning and reconstruction
US12020379B2 (en) 2020-04-17 2024-06-25 Apple Inc. Virtual anchoring systems and methods for extended reality
US12496721B2 (en) 2020-05-08 2025-12-16 Samsung Electronics Co., Ltd. Virtual presence for telerobotics in a dynamic scene
US11783550B2 (en) 2020-09-17 2023-10-10 Apple Inc. Image composition for extended reality systems
JP7543836B2 (ja) * 2020-10-22 2024-09-03 富士フイルムビジネスイノベーション株式会社 情報処理装置及び情報処理プログラム
US11615592B2 (en) 2020-10-27 2023-03-28 Snap Inc. Side-by-side character animation from realtime 3D body motion capture
US11660022B2 (en) 2020-10-27 2023-05-30 Snap Inc. Adaptive skeletal joint smoothing
US11734894B2 (en) 2020-11-18 2023-08-22 Snap Inc. Real-time motion transfer for prosthetic limbs
US11748931B2 (en) 2020-11-18 2023-09-05 Snap Inc. Body animation sharing and remixing
US11450051B2 (en) 2020-11-18 2022-09-20 Snap Inc. Personalized avatar real-time motion capture
US20230260240A1 (en) * 2021-03-11 2023-08-17 Quintar, Inc. Alignment of 3d graphics extending beyond frame in augmented reality system with remote presentation
US11715495B2 (en) * 2021-05-26 2023-08-01 Flawless Holdings Limited Modification of objects in film
US11398255B1 (en) 2021-05-26 2022-07-26 Flawless Holdings Limited Modification of objects in film
US11822713B2 (en) * 2021-06-11 2023-11-21 Rockwell Collins, Inc. Pose augmentation of head worn display video for latency reduction
US11568552B2 (en) * 2021-06-28 2023-01-31 Varjo Technologies Oy Imaging systems and methods incorporating improved culling of virtual objects
US12223672B2 (en) 2021-12-21 2025-02-11 Snap Inc. Real-time garment exchange
US11880947B2 (en) 2021-12-21 2024-01-23 Snap Inc. Real-time upper-body garment exchange
US12198398B2 (en) 2021-12-21 2025-01-14 Snap Inc. Real-time motion and appearance transfer

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7168953B1 (en) * 2003-01-27 2007-01-30 Massachusetts Institute Of Technology Trainable videorealistic speech animation
US8150101B2 (en) * 2006-11-13 2012-04-03 Cybernet Systems Corporation Orientation invariant object identification using model-based image processing
WO2008079301A2 (en) * 2006-12-21 2008-07-03 Massachusetts Institute Of Technology Methods and apparatus for 3d surface imaging using active wave-front sampling
US8175413B1 (en) * 2009-03-05 2012-05-08 Google Inc. Video identification through detection of proprietary rights logos in media
US8768313B2 (en) * 2009-08-17 2014-07-01 Digimarc Corporation Methods and systems for image or audio recognition processing
US9230300B2 (en) 2009-10-22 2016-01-05 Tim Bekaert Method for creating a mosaic image using masks
EP2383696A1 (en) * 2010-04-30 2011-11-02 LiberoVision AG Method for estimating a pose of an articulated object model
KR20120113058A (ko) 2011-04-04 2012-10-12 한국전자통신연구원 현실-가상 융합 공간 기반의 교육 장치 및 방법
US9053571B2 (en) 2011-06-06 2015-06-09 Microsoft Corporation Generating computer models of 3D objects
EP2729916A4 (en) 2011-07-04 2015-04-08 Lee Vincent Streeter MOTION COMPENSATION IN A AREA IMAGING
US9255813B2 (en) 2011-10-14 2016-02-09 Microsoft Technology Licensing, Llc User controlled real object disappearance in a mixed reality display

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
杉本一平，他４名: "複合現実感のための隠消現実感：トラッキング性能向上目的で配置した人工物の視覚的除去", 第１６回日本バーチャルリアリティ学会大会 論文集 ［ＣＤ−ＲＯＭ］, JPN6018017463, September 2011 (2011-09-01), JP, pages 318 - 321, ISSN: 0003796952 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018129026A (ja) * 2017-02-07 2018-08-16 日本電信電話株式会社 決定装置、画像処理装置、決定方法及び決定プログラム
KR20190036868A (ko) * 2017-09-28 2019-04-05 한국과학기술원 가시광 통신을 이용한 실내공간의 증강현실 제공 시스템 및 그 방법
KR101971791B1 (ko) * 2017-09-28 2019-04-23 한국과학기술원 가시광 통신을 이용한 실내공간의 증강현실 제공 시스템 및 그 방법
JP2019091436A (ja) * 2017-10-18 2019-06-13 ダッソー システムズＤａｓｓａｕｌｔ Ｓｙｓｔｅｍｅｓ ３ｄ配置のタイプに応じた２ｄ画像の分類
JP7294788B2 (ja) 2017-10-18 2023-06-20 ダッソー システムズ ３ｄ配置のタイプに応じた２ｄ画像の分類
JP2019152899A (ja) * 2018-02-28 2019-09-12 株式会社バンダイナムコスタジオ シミュレーションシステム及びプログラム
US11645822B2 (en) 2020-12-21 2023-05-09 Toyota Jidosha Kabushiki Kaisha Display system and display device for rendering of a virtual object of a departure point
WO2025163772A1 (ja) * 2024-01-30 2025-08-07 Ｎｔｔ株式会社 映像処理装置
WO2025238724A1 (ja) * 2024-05-14 2025-11-20 Ｎｔｔ株式会社 情報提示装置、情報提示方法およびプログラム

Also Published As

Publication number Publication date
US20140321702A1 (en) 2014-10-30
WO2014178966A1 (en) 2014-11-06
EP2992508A1 (en) 2016-03-09
US9269003B2 (en) 2016-02-23
EP2992508B1 (en) 2019-01-16
CN105164728B (zh) 2018-02-06
CN105164728A (zh) 2015-12-16

Similar Documents

Publication Publication Date Title
US9269003B2 (en) Diminished and mediated reality effects from reconstruction
US11288857B2 (en) Neural rerendering from 3D models
US11481982B2 (en) In situ creation of planar natural feature targets
JP6258953B2 (ja) 単眼視覚ｓｌａｍのための高速初期化
CN110322542B (zh) 重建真实世界3d场景的视图
CN105283905B (zh) 使用点和线特征的稳健跟踪
US8878846B1 (en) Superimposing virtual views of 3D objects with live images
TWI583176B (zh) 具有功率有效深度感測器運用之即時三維重建
US11854230B2 (en) Physical keyboard tracking
US20130293686A1 (en) 3d reconstruction of human subject using a mobile device
US20130127988A1 (en) Modifying the viewpoint of a digital image
US11451758B1 (en) Systems, methods, and media for colorizing grayscale images
US8611642B2 (en) Forming a steroscopic image using range map
US20130129192A1 (en) Range map determination for a video frame
WO2015142446A1 (en) Augmented reality lighting with dynamic geometry
TW202332263A (zh) 立體影像播放裝置及其立體影像產生方法
JP6845490B2 (ja) 自由動作ｆｖｖアプリケーションのためのマルチレイヤｕｖマップに基づくテクスチャレンダリング
US20210082176A1 (en) Passthrough visualization
CN115564639B (zh) 背景虚化方法、装置、计算机设备和存储介质
CN115409949A (zh) 模型训练方法、视角图像生成方法、装置、设备及介质
CN110310325A (zh) 一种虚拟测量方法、电子设备及计算机可读存储介质
US20240119568A1 (en) View Synthesis Pipeline for Rendering Passthrough Images
KR20120118462A (ko) 이미지 기반의 비주얼 헐에서의 오목 표면 모델링
US12354280B2 (en) Reconstructing a three-dimensional scene

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170310

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170310

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180521

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20180821

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20190204