CN105493154B - 用于确定增强现实环境中的平面的范围的系统和方法 - Google Patents

用于确定增强现实环境中的平面的范围的系统和方法 Download PDF

Info

Publication number
CN105493154B
CN105493154B CN201480046887.6A CN201480046887A CN105493154B CN 105493154 B CN105493154 B CN 105493154B CN 201480046887 A CN201480046887 A CN 201480046887A CN 105493154 B CN105493154 B CN 105493154B
Authority
CN
China
Prior art keywords
map
planar object
support
plane surface
boundary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201480046887.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN105493154A (zh
Inventor
格哈德·赖特迈尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN105493154A publication Critical patent/CN105493154A/zh
Application granted granted Critical
Publication of CN105493154B publication Critical patent/CN105493154B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/32—Determination of transform parameters for the alignment of images, i.e. image registration using correlation-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Geometry (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Processing (AREA)
CN201480046887.6A 2013-08-30 2014-08-20 用于确定增强现实环境中的平面的范围的系统和方法 Expired - Fee Related CN105493154B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201361872436P 2013-08-30 2013-08-30
US61/872,436 2013-08-30
US14/268,721 US9514574B2 (en) 2013-08-30 2014-05-02 System and method for determining the extent of a plane in an augmented reality environment
US14/268,721 2014-05-02
PCT/US2014/051955 WO2015031139A1 (en) 2013-08-30 2014-08-20 System and method for determining the extent of a plane in an augmented reality environment

Publications (2)

Publication Number Publication Date
CN105493154A CN105493154A (zh) 2016-04-13
CN105493154B true CN105493154B (zh) 2019-05-31

Family

ID=52582548

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480046887.6A Expired - Fee Related CN105493154B (zh) 2013-08-30 2014-08-20 用于确定增强现实环境中的平面的范围的系统和方法

Country Status (6)

Country Link
US (1) US9514574B2 (enExample)
EP (1) EP3039655B1 (enExample)
JP (1) JP6203406B2 (enExample)
KR (1) KR20160048901A (enExample)
CN (1) CN105493154B (enExample)
WO (1) WO2015031139A1 (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9304582B1 (en) * 2013-12-19 2016-04-05 Amazon Technologies, Inc. Object-based color detection and correction
WO2016079960A1 (en) * 2014-11-18 2016-05-26 Seiko Epson Corporation Image processing apparatus, control method for image processing apparatus, and computer program
JP2017007033A (ja) * 2015-06-22 2017-01-12 シャープ株式会社 ロボット
JP6602096B2 (ja) * 2015-08-18 2019-11-06 株式会社明和ｅテック 欠陥検出装置
US10088736B2 (en) 2015-09-24 2018-10-02 Amazon Technologies, Inc. Unmanned aerial vehicle descent
EP3475923B1 (en) 2016-06-27 2025-03-12 Robert Bosch GmbH Systems and methods for dynamic occlusion handling
US10565786B1 (en) * 2016-06-30 2020-02-18 Google Llc Sensor placement interface
CA3037276A1 (en) * 2016-10-05 2018-04-12 Magic Leap, Inc. Surface modeling systems and methods
CN108629800A (zh) * 2017-03-20 2018-10-09 北京三星通信技术研究有限公司 平面确定方法及增强现实显示信息的显示方法、相应装置
DK180470B1 (en) 2017-08-31 2021-05-06 Apple Inc Systems, procedures, and graphical user interfaces for interacting with augmented and virtual reality environments
US10402646B2 (en) 2017-09-21 2019-09-03 Amazon Technologies, Inc. Object detection and avoidance for aerial vehicles
EP3468182A1 (en) * 2017-10-06 2019-04-10 InterDigital VC Holdings, Inc. A method and apparatus for encoding a point cloud representing three-dimensional objects
KR102509823B1 (ko) * 2017-12-27 2023-03-14 삼성전자주식회사 그리드 기반의 평면 추정 방법 및 장치
DK201870346A1 (en) 2018-01-24 2019-09-12 Apple Inc. Devices, Methods, and Graphical User Interfaces for System-Wide Behavior for 3D Models
US11126257B2 (en) * 2018-04-17 2021-09-21 Toyota Research Institute, Inc. System and method for detecting human gaze and gesture in unconstrained environments
KR102540546B1 (ko) 2018-08-23 2023-06-05 현대자동차주식회사 가솔린 egr 시스템의 밸브개방 제어장치 및 방법
CN110070600B (zh) * 2018-11-02 2023-09-15 北京微播视界科技有限公司 三维模型的生成方法、装置、硬件装置
CN109472873B (zh) * 2018-11-02 2023-09-19 北京微播视界科技有限公司 三维模型的生成方法、装置、硬件装置
JP7194752B2 (ja) 2018-12-13 2022-12-22 マクセル株式会社 表示端末、表示制御システムおよび表示制御方法
JP2020148712A (ja) * 2019-03-15 2020-09-17 東芝インフォメーションシステムズ株式会社 測距システム、測距装置及び配置方法
US11030474B1 (en) 2019-05-28 2021-06-08 Apple Inc. Planar region boundaries based on intersection
JP2021033572A (ja) * 2019-08-22 2021-03-01 株式会社豊田自動織機 画像データ収集装置及び画像データ仕分け方法
WO2021086355A1 (en) * 2019-10-30 2021-05-06 Hewlett-Packard Development Company, L.P. Camera pose determinations with depth
JP7366797B2 (ja) * 2020-02-19 2023-10-23 株式会社Ｉｈｉインフラシステム コンクリート床版の平坦度計測装置
US12020379B2 (en) * 2020-04-17 2024-06-25 Apple Inc. Virtual anchoring systems and methods for extended reality
US12254244B1 (en) * 2020-04-24 2025-03-18 Apple Inc. 2D floorplan pipeline and refinement
KR20210157601A (ko) 2020-06-22 2021-12-29 현대자동차주식회사 결빙 개선을 위한 lp-egr 시스템의 제어장치 및 방법
CN111899293B (zh) * 2020-09-29 2021-01-08 成都索贝数码科技股份有限公司 Ar应用中的虚实遮挡处理方法
US11960009B2 (en) * 2020-12-30 2024-04-16 Zoox, Inc. Object contour determination
US12030522B2 (en) 2020-12-30 2024-07-09 Zoox, Inc. Collision avoidance using an object contour
US11972524B2 (en) * 2021-03-30 2024-04-30 Hcl Technologies Limited Method and system for generating tightest revolve envelope for computer-aided design (CAD) model

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050135670A1 (en) * 2003-12-17 2005-06-23 Janakiraman Vaidyanathan CAD modeling system and method
CN102509342A (zh) * 2011-09-22 2012-06-20 北京航空航天大学 一种共享增强现实场景中协同式虚实遮挡处理方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6420698B1 (en) 1997-04-24 2002-07-16 Cyra Technologies, Inc. Integrated system for quickly and accurately imaging and modeling three-dimensional objects
US7509241B2 (en) 2001-07-06 2009-03-24 Sarnoff Corporation Method and apparatus for automatically generating a site model
EP1694821B1 (en) 2003-12-11 2017-07-05 Strider Labs, Inc. Probable reconstruction of surfaces in occluded regions by computed symmetry
JP2006065608A (ja) * 2004-08-27 2006-03-09 Fuji Xerox Co Ltd ３次元モデル生成装置および方法
JP2006323608A (ja) * 2005-05-18 2006-11-30 Kozo Keikaku Engineering Inc 立体構造物群モデル作成装置、立体構造物群モデル作成方法及び立体モデル作成システム
US20110205226A1 (en) 2008-10-28 2011-08-25 Koninklijke Philips Electronics N.V. Generation of occlusion data for image properties
US8933925B2 (en) 2009-06-15 2015-01-13 Microsoft Corporation Piecewise planar reconstruction of three-dimensional scenes
KR101686169B1 (ko) * 2010-02-09 2016-12-14 삼성전자주식회사 옥트리 기반의 3차원 맵 생성 장치 및 방법
US9092657B2 (en) * 2013-03-13 2015-07-28 Microsoft Technology Licensing, Llc Depth image processing

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050135670A1 (en) * 2003-12-17 2005-06-23 Janakiraman Vaidyanathan CAD modeling system and method
CN102509342A (zh) * 2011-09-22 2012-06-20 北京航空航天大学 一种共享增强现实场景中协同式虚实遮挡处理方法

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
David E. Breen et al..Interactive Occlusion and Automatic Object Placement for Augmented Reality.《Computer Graphics Forum》.1996,第15卷(第3期),参见第3-5部分. *
Interactive Occlusion and Automatic Object Placement for Augmented Reality;David E. Breen et al.;《Computer Graphics Forum》;19960831;第15卷(第3期);参见第3-5部分 *
Resolving Occlusion in Augmented Reality: a Contour Based Approach without 3D Reconstruction;M.O.Berger;《1997 Conference on Computer Vision and Pattern Recognition》;19970131;第4部分，图4 *

Also Published As

Publication number Publication date
WO2015031139A1 (en) 2015-03-05
EP3039655A1 (en) 2016-07-06
US20150062117A1 (en) 2015-03-05
EP3039655B1 (en) 2020-04-29
JP2016534466A (ja) 2016-11-04
CN105493154A (zh) 2016-04-13
KR20160048901A (ko) 2016-05-04
US9514574B2 (en) 2016-12-06
JP6203406B2 (ja) 2017-09-27

Similar Documents

Publication Publication Date Title
CN105493154B (zh) 用于确定增强现实环境中的平面的范围的系统和方法
AU2020202551B2 (en) Method for representing points of interest in a view of a real environment on a mobile device and mobile device therefor
US11842514B1 (en) Determining a pose of an object from rgb-d images
CN113487742B (zh) 用于生成三维模型的方法和系统
KR101993920B1 (ko) 물리적 장면을 표현하기 위한 방법 및 장치
US9898844B2 (en) Augmented reality content adapted to changes in real world space geometry
US11557080B2 (en) Dynamically modeling an object in an environment from different perspectives
US20150185825A1 (en) Assigning a virtual user interface to a physical object
US20150187137A1 (en) Physical object discovery
JP6609640B2 (ja) 電子デバイス上における環境マッピング用のフィーチャ・データの管理
KR101794148B1 (ko) 효율적인 자유 공간 손가락 인식
EP3594906B1 (en) Method and device for providing augmented reality, and computer program
CN105531740A (zh) 扩展物理平面的数字表示
CN121002540A (zh) 增强现实组分与物理世界的对齐
KR20130015617A (ko) 포즈 예측 방법과 장치 그리고 증강 현실 시스템
HK1177310A1 (en) Deep camera compatibility

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190531

Termination date: 20210820

CF01 Termination of patent right due to non-payment of annual fee