EP3994673A4 - Résolveur d'environnement simple utilisant une extraction plane - Google Patents

Résolveur d'environnement simple utilisant une extraction plane Download PDF

Info

Publication number
EP3994673A4
EP3994673A4 EP20835012.4A EP20835012A EP3994673A4 EP 3994673 A4 EP3994673 A4 EP 3994673A4 EP 20835012 A EP20835012 A EP 20835012A EP 3994673 A4 EP3994673 A4 EP 3994673A4
Authority
EP
European Patent Office
Prior art keywords
solver
simple environment
planar extraction
planar
extraction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20835012.4A
Other languages
German (de)
English (en)
Other versions
EP3994673A1 (fr
Inventor
Benjamin Joseph USCINSKI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of EP3994673A1 publication Critical patent/EP3994673A1/fr
Publication of EP3994673A4 publication Critical patent/EP3994673A4/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/187—Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/564—Depth or shape recovery from multiple images from contours
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/04—Architectural design, interior design

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Health & Medical Sciences (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Generation (AREA)
EP20835012.4A 2019-07-03 2020-06-25 Résolveur d'environnement simple utilisant une extraction plane Pending EP3994673A4 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962870193P 2019-07-03 2019-07-03
PCT/US2020/039631 WO2021003058A1 (fr) 2019-07-03 2020-06-25 Résolveur d'environnement simple utilisant une extraction plane

Publications (2)

Publication Number Publication Date
EP3994673A1 EP3994673A1 (fr) 2022-05-11
EP3994673A4 true EP3994673A4 (fr) 2023-10-04

Family

ID=74066427

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20835012.4A Pending EP3994673A4 (fr) 2019-07-03 2020-06-25 Résolveur d'environnement simple utilisant une extraction plane

Country Status (5)

Country Link
US (2) US11508141B2 (fr)
EP (1) EP3994673A4 (fr)
JP (1) JP2022539160A (fr)
CN (1) CN114341943A (fr)
WO (1) WO2021003058A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI766218B (zh) * 2019-12-27 2022-06-01 財團法人工業技術研究院 三維平面重建方法、三維平面重建系統與計算裝置
JP2023534045A (ja) * 2020-07-16 2023-08-07 株式会社ソニー・インタラクティブエンタテインメント フォロワ視聴者向けのインフルエンサストリームのカスタマイゼーション
CN113240789B (zh) * 2021-04-13 2023-05-23 青岛小鸟看看科技有限公司 虚拟对象构建方法及装置
US11562529B2 (en) * 2021-06-23 2023-01-24 Meta Platforms Technologies, Llc Generating and modifying an artificial reality environment using occlusion surfaces at predetermined distances
US11961184B2 (en) 2021-09-17 2024-04-16 Samsung Electronics Co., Ltd. System and method for scene reconstruction with plane and surface reconstruction
KR102669261B1 (ko) * 2021-10-15 2024-05-28 (주)이머시브캐스트 클라우드 xr 기반의 프로그램 가상화 방법
US20240029363A1 (en) * 2022-07-20 2024-01-25 Qualcomm Incorporated Late stage occlusion based rendering for extended reality (xr)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180182176A1 (en) * 2013-09-11 2018-06-28 Qualcomm Incorporated Structural modeling using depth sensors

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2465793A (en) * 2008-11-28 2010-06-02 Sony Corp Estimating camera angle using extrapolated corner locations from a calibration pattern
CN106663411A (zh) * 2014-11-16 2017-05-10 易欧耐特感知公司 用于增强现实准备、处理和应用的系统和方法
US11927965B2 (en) * 2016-02-29 2024-03-12 AI Incorporated Obstacle recognition method for autonomous robots
US10650552B2 (en) * 2016-12-29 2020-05-12 Magic Leap, Inc. Systems and methods for augmented reality
US10809795B2 (en) * 2017-05-31 2020-10-20 Occipital, Inc. Six degree of freedom tracking with scale recovery and obstacle avoidance
US10816334B2 (en) 2017-12-04 2020-10-27 Microsoft Technology Licensing, Llc Augmented reality measurement and schematic system including tool having relatively movable fiducial markers
EP3729381B1 (fr) * 2017-12-22 2023-01-18 Magic Leap, Inc. Sélection de briques dépendant du point de vue pour une reconstruction volumétrique rapide
CN108961395B (zh) * 2018-07-03 2019-07-30 上海亦我信息技术有限公司 一种基于拍照重建三维空间场景的方法
US10733800B2 (en) * 2018-09-17 2020-08-04 Facebook Technologies, Llc Reconstruction of essential visual cues in mixed reality applications
EP3991091A4 (fr) * 2019-06-26 2023-11-08 Magic Leap, Inc. Mise en cache, et mise à jour de données de reconstruction 3d denses

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180182176A1 (en) * 2013-09-11 2018-06-28 Qualcomm Incorporated Structural modeling using depth sensors

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
"LECTURE NOTES IN COMPUTER SCIENCE", vol. 7416, 1 January 2012, SPRINGER BERLIN HEIDELBERG, Berlin, Heidelberg, ISBN: 978-3-54-045234-8, ISSN: 0302-9743, article DIRK HOLZ ET AL: "Real-Time Plane Segmentation Using RGB-D Cameras", pages: 306 - 317, XP055141796, DOI: 10.1007/978-3-642-32060-6_26 *
HOLZ DIRK ET AL: "Approximate triangulation and region growing for efficient segmentation and smoothing of range images", ROBOTICS AND AUTONOMOUS SYSTEMS, vol. 62, no. 9, 3 April 2014 (2014-04-03), pages 1282 - 1293, XP028864068, ISSN: 0921-8890, DOI: 10.1016/J.ROBOT.2014.03.013 *
NGUYEN THANH ET AL: "Structural Modeling from Depth Images", IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, IEEE, USA, vol. 21, no. 11, 15 November 2015 (2015-11-15), pages 1230 - 1240, XP011670352, ISSN: 1077-2626, [retrieved on 20150930], DOI: 10.1109/TVCG.2015.2459831 *
YOUNG MIN KIM ET AL: "Interactive acquisition of residential floor plans", ROBOTICS AND AUTOMATION (ICRA), 2012 IEEE INTERNATIONAL CONFERENCE ON, IEEE, 14 May 2012 (2012-05-14), pages 3055 - 3062, XP032450326, ISBN: 978-1-4673-1403-9, DOI: 10.1109/ICRA.2012.6224595 *

Also Published As

Publication number Publication date
WO2021003058A1 (fr) 2021-01-07
US20230037459A1 (en) 2023-02-09
EP3994673A1 (fr) 2022-05-11
US11508141B2 (en) 2022-11-22
CN114341943A (zh) 2022-04-12
JP2022539160A (ja) 2022-09-07
US20210004630A1 (en) 2021-01-07

Similar Documents

Publication Publication Date Title
EP3994673A4 (fr) Résolveur d'environnement simple utilisant une extraction plane
EP3861437A4 (fr) Réalisation de tests sur un logiciel
EP3726399A4 (fr) Multiplicateur matriciel
EP3701404A4 (fr) Système de jeu à technologie chaîne de blocs
EP3403187A4 (fr) Analyse de delta en un seul clic
EP3665201A4 (fr) Agents de liaison au cd8
EP3465705A4 (fr) Carte électronique à interfaces multiples
EP3376366A4 (fr) Affichage de contenu au moyen de multiples dispositifs d'affichage
EP3347798A4 (fr) Stylet semi-passif
EP3303866A4 (fr) Dispositif d'isolation amélioré
EP3695073A4 (fr) Dispositif d'espacement de dalles
EP3508843A4 (fr) Dispositif de traitement de données de spectrométrie de masse
EP3704247A4 (fr) Analyse génomique basée sur la transposase
EP3630968B8 (fr) Des enzymes pour l'analyse des glycanes
EP3405231A4 (fr) Connecteurs à usage unique
EP3392640A4 (fr) Dispositif d'introduction d'échantillon
EP3607577A4 (fr) Analyseur de masse
EP3583486A4 (fr) Processeur à super fils
EP3557241A4 (fr) Dispositif de spectrométrie de masse
EP3807076A4 (fr) Unité d'extraction de liquide
EP3625652A4 (fr) Interface de sélection de caractères entrelacés
EP3454741A4 (fr) Système de test de substance psychotrope
EP3366745A4 (fr) Adhésif mettant en uvre de l'écorce
EP3779421A4 (fr) Bio-capteur
EP3594991A4 (fr) Spectromètre de masse

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220201

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 7/50 20170101ALI20230531BHEP

Ipc: G06T 7/11 20170101ALI20230531BHEP

Ipc: G06T 19/20 20110101ALI20230531BHEP

Ipc: G06T 19/00 20110101AFI20230531BHEP

A4 Supplementary search report drawn up and despatched

Effective date: 20230906

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 7/50 20170101ALI20230831BHEP

Ipc: G06T 7/11 20170101ALI20230831BHEP

Ipc: G06T 19/20 20110101ALI20230831BHEP

Ipc: G06T 19/00 20110101AFI20230831BHEP