CA2987087A1 - Method for 3d reconstruction of an environment of a mobile device, corresponding computer program product and device - Google Patents

Method for 3d reconstruction of an environment of a mobile device, corresponding computer program product and device Download PDF

Info

Publication number
CA2987087A1
CA2987087A1 CA2987087A CA2987087A CA2987087A1 CA 2987087 A1 CA2987087 A1 CA 2987087A1 CA 2987087 A CA2987087 A CA 2987087A CA 2987087 A CA2987087 A CA 2987087A CA 2987087 A1 CA2987087 A1 CA 2987087A1
Authority
CA
Canada
Prior art keywords
reconstruction
cndot
target part
environment
mobile device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA2987087A
Other languages
English (en)
French (fr)
Inventor
Tao Luo
Philippe Robert
Vincent Alleaume
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital CE Patent Holdings SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of CA2987087A1 publication Critical patent/CA2987087A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/586—Depth or shape recovery from multiple images from multiple light sources, e.g. photometric stereo
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2211/00—Image generation
    • G06T2211/40—Computed tomography
    • G06T2211/416—Exact reconstruction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Electromagnetism (AREA)
  • Architecture (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Studio Devices (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
CA2987087A 2016-12-01 2017-11-30 Method for 3d reconstruction of an environment of a mobile device, corresponding computer program product and device Abandoned CA2987087A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16306599.8 2016-12-01
EP16306599.8A EP3330924A1 (en) 2016-12-01 2016-12-01 Method for 3d reconstruction of an environment of a mobile device, corresponding computer program product and device

Publications (1)

Publication Number Publication Date
CA2987087A1 true CA2987087A1 (en) 2018-06-01

Family

ID=57542932

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2987087A Abandoned CA2987087A1 (en) 2016-12-01 2017-11-30 Method for 3d reconstruction of an environment of a mobile device, corresponding computer program product and device

Country Status (10)

Country Link
US (1) US20180160102A1 (enExample)
EP (2) EP3330924A1 (enExample)
JP (1) JP2018124984A (enExample)
KR (1) KR20180062959A (enExample)
CN (1) CN108133495A (enExample)
BR (1) BR102017025905A2 (enExample)
CA (1) CA2987087A1 (enExample)
MX (1) MX373029B (enExample)
PL (1) PL3330925T3 (enExample)
RU (1) RU2017141588A (enExample)

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10535156B2 (en) * 2017-02-03 2020-01-14 Microsoft Technology Licensing, Llc Scene reconstruction from bursts of image data
US11436791B2 (en) * 2018-04-30 2022-09-06 The Regents Of The University Of California Methods and systems for acquiring svBRDF measurements
CN110706280A (zh) * 2018-09-28 2020-01-17 成都家有为力机器人技术有限公司 基于2d-slam的轻量级语义驱动的稀疏重建方法
WO2020076026A1 (ko) * 2018-10-08 2020-04-16 한국과학기술원 인공조명 사진을 이용한 3차원 객체 획득 방법 및 그 장치
KR102287472B1 (ko) 2018-10-08 2021-08-09 한국과학기술원 인공조명 사진을 이용한 3차원 객체 획득 방법 및 그 장치
CN109492607B (zh) * 2018-11-27 2021-07-09 Oppo广东移动通信有限公司 一种信息推送方法、信息推送装置及终端设备
US11783443B2 (en) 2019-01-22 2023-10-10 Fyusion, Inc. Extraction of standardized images from a single view or multi-view capture
US12204869B2 (en) 2019-01-22 2025-01-21 Fyusion, Inc. Natural language understanding for visual tagging
US10887582B2 (en) 2019-01-22 2021-01-05 Fyusion, Inc. Object damage aggregation
US11176704B2 (en) 2019-01-22 2021-11-16 Fyusion, Inc. Object pose estimation in visual data
WO2020154096A1 (en) 2019-01-22 2020-07-30 Fyusion, Inc. Damage detection from multi-view visual data
US12243170B2 (en) 2019-01-22 2025-03-04 Fyusion, Inc. Live in-camera overlays
US12203872B2 (en) 2019-01-22 2025-01-21 Fyusion, Inc. Damage detection from multi-view visual data
WO2020195877A1 (ja) * 2019-03-25 2020-10-01 ソニー株式会社 医療システム、信号処理装置、及び、信号処理方法
US12244784B2 (en) 2019-07-29 2025-03-04 Fyusion, Inc. Multiview interactive digital media representation inventory verification
GB2586157B (en) * 2019-08-08 2022-01-12 Toshiba Kk System and method for performing 3D imaging of an object
US12026827B2 (en) 2019-12-20 2024-07-02 Uisee Technologies (Zhejiang) Ltd. Method, apparatus, system, and storage medium for 3D reconstruction
US11252398B2 (en) 2020-01-16 2022-02-15 Fyusion, Inc. Creating cinematic video from multi-view capture data
US11776142B2 (en) 2020-01-16 2023-10-03 Fyusion, Inc. Structuring visual data
US11869135B2 (en) * 2020-01-16 2024-01-09 Fyusion, Inc. Creating action shot video from multi-view capture data
US11562474B2 (en) 2020-01-16 2023-01-24 Fyusion, Inc. Mobile multi-camera multi-view capture
JP2021131652A (ja) * 2020-02-19 2021-09-09 株式会社トプコン データ構造、記録媒体、プログラム、及びシステム
JP7611648B2 (ja) 2020-03-05 2025-01-10 株式会社トプコン 情報処理装置、推論モデル構築方法、プログラム、及び記録媒体
CN111459274B (zh) * 2020-03-30 2021-09-21 华南理工大学 一种基于5g+ ar的针对非结构化环境的遥操作方法
CN111583263B (zh) * 2020-04-30 2022-09-23 北京工业大学 一种基于联合动态图卷积的点云分割方法
KR102819575B1 (ko) 2020-10-12 2025-06-12 삼성전자주식회사 전자 장치 및 제어 방법
CN114430454A (zh) * 2020-10-28 2022-05-03 广东小天才科技有限公司 基于双摄像头的建模方法及可穿戴装置、设备和介质
US11605151B2 (en) 2021-03-02 2023-03-14 Fyusion, Inc. Vehicle undercarriage imaging
JP2023174401A (ja) * 2022-05-27 2023-12-07 シャープ株式会社 情報処理装置、サーバ、情報処理方法、およびプログラム
CN120894518B (zh) * 2025-07-11 2026-05-29 齐鲁工业大学(山东省科学院) 一种基于场景环境选择的3dgs重建方法及系统

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6750873B1 (en) * 2000-06-27 2004-06-15 International Business Machines Corporation High quality texture reconstruction from multiple scans
WO2004006180A2 (en) * 2002-07-10 2004-01-15 Harman Becker Automotive Systems Gmbh System for texturizing electronic representations of objects
US8655052B2 (en) * 2007-01-26 2014-02-18 Intellectual Discovery Co., Ltd. Methodology for 3D scene reconstruction from 2D image sequences
JP2012141894A (ja) * 2011-01-05 2012-07-26 Sharp Corp 画像検索装置、画像検索方法およびプログラム
US9679215B2 (en) * 2012-01-17 2017-06-13 Leap Motion, Inc. Systems and methods for machine control
US9857470B2 (en) * 2012-12-28 2018-01-02 Microsoft Technology Licensing, Llc Using photometric stereo for 3D environment modeling
US9102055B1 (en) * 2013-03-15 2015-08-11 Industrial Perception, Inc. Detection and reconstruction of an environment to facilitate robotic interaction with the environment
US9996974B2 (en) * 2013-08-30 2018-06-12 Qualcomm Incorporated Method and apparatus for representing a physical scene
JP6465682B2 (ja) * 2014-03-20 2019-02-06 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
KR20160131278A (ko) * 2015-05-06 2016-11-16 엘지전자 주식회사 이동 단말기
GB2544725A (en) * 2015-11-03 2017-05-31 Fuel 3D Tech Ltd Systems and methods for forming models of a three-dimensional objects
US10055882B2 (en) * 2016-08-15 2018-08-21 Aquifi, Inc. System and method for three-dimensional scanning and for capturing a bidirectional reflectance distribution function

Also Published As

Publication number Publication date
EP3330924A1 (en) 2018-06-06
JP2018124984A (ja) 2018-08-09
EP3330925A1 (en) 2018-06-06
PL3330925T3 (pl) 2020-03-31
MX2017015345A (es) 2018-11-09
RU2017141588A (ru) 2019-05-29
MX373029B (es) 2020-05-27
KR20180062959A (ko) 2018-06-11
CN108133495A (zh) 2018-06-08
US20180160102A1 (en) 2018-06-07
BR102017025905A2 (pt) 2018-12-18
EP3330925B1 (en) 2019-10-02

Similar Documents

Publication Publication Date Title
EP3330925B1 (en) Method for 3d reconstruction of an environment of a mobile device, corresponding computer program product and device
Huang et al. Indoor depth completion with boundary consistency and self-attention
US9679384B2 (en) Method of detecting and describing features from an intensity image
CN106993112B (zh) 基于景深的背景虚化方法及装置和电子装置
US8687001B2 (en) Apparatus and method extracting light and texture, and rendering apparatus using light and texture
US9400941B2 (en) Method of matching image features with reference features
US10008024B2 (en) Material-aware three-dimensional scanning
US9525862B2 (en) Method for estimating a camera motion and for determining a three-dimensional model of a real environment
US20160335809A1 (en) Three-dimensional model generation
US10607350B2 (en) Method of detecting and describing features from an intensity image
US12423859B2 (en) Depth sensor activation for localization based on data from monocular camera
US12293593B2 (en) Object detection method, object detection device, terminal device, and medium
US11551368B2 (en) Electronic devices, methods, and computer program products for controlling 3D modeling operations based on pose metrics
Yeh et al. 3D reconstruction and visual SLAM of indoor scenes for augmented reality application
JP6817742B2 (ja) 情報処理装置およびその制御方法
CN109345484A (zh) 一种深度图修复方法及装置
Wang et al. Combining semantic scene priors and haze removal for single image depth estimation
US11205064B1 (en) Measuring quality of depth images in real time
Kröhnert Automatic waterline extraction from smartphone images
KR20240131600A (ko) 센서를 이용한 객체 크기 추정 시스템 및 방법
CN111178413A (zh) 一种3d点云语义分割的方法、装置及系统
US20250054176A1 (en) Bounding box transformation for object depth estimation in a multi-camera device
Jang et al. An adaptive camera-selection algorithm to acquire higher-quality images
KR20260052112A (ko) 멀티-카메라 디바이스에서의 객체 깊이 추정을 위한 경계 상자 변환
CN119865589A (zh) 一种实时投影方法，投影设备，及存储介质

Legal Events

Date Code Title Description
FZDE Discontinued

Effective date: 20220531